Apr 28 16:05:37 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:05:37 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:05:37 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:05:38 devstack cinder-volume[75450]: INFO dbcounter [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Registered counter for database cinder Apr 28 16:05:38 devstack cinder-volume[75450]: DEBUG oslo_db.sqlalchemy.engines [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:05:38 devstack cinder-volume[75450]: DEBUG dbcounter [-] [75450] Writer thread running {{(pid=75450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:05:38 devstack cinder-volume[75450]: INFO cinder.rpc [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 16:05:38 devstack cinder-volume[75450]: INFO cinder.rpc [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 16:05:38 devstack cinder-volume[75450]: DEBUG oslo_db.sqlalchemy.engines [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:05:38 devstack cinder-volume[75450]: INFO cinder.volume.manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Determined volume DB was empty at startup. Apr 28 16:05:38 devstack cinder-volume[75450]: DEBUG cinder.volume.manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75450) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 16:05:38 devstack cinder-volume[75450]: INFO cinder.volume.manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 16:05:38 devstack cinder-volume[75450]: WARNING stevedore.named [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 16:05:38 devstack cinder-volume[75450]: WARNING castellan.key_manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:05:38 devstack cinder-volume[75450]: WARNING cinder.keymgr.conf_key_mgr [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG cinder.volume.drivers.lvm [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75450) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_concurrency.processutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_concurrency.processutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] CMD "cinder-rtstool verify" returned: 0 in 0.354s {{(pid=75450) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_db.sqlalchemy.engines [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:05:39 devstack cinder-volume[75450]: INFO cinder.rpc [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 28 16:05:39 devstack cinder-volume[75450]: INFO cinder.rpc [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 28 16:05:39 devstack cinder-volume[75450]: WARNING stevedore.named [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 16:05:39 devstack cinder-volume[75450]: WARNING castellan.key_manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:05:39 devstack cinder-volume[75450]: INFO cinder.volume.manager [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_db.sqlalchemy.engines [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:05:39 devstack cinder-volume[75450]: INFO oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Starting 1 workers Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Started child 75622 {{(pid=75450) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Full set of CONF: {{(pid=75450) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] ******************************************************************************** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Configuration options gathered from: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] ================================================================================ {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] allow_availability_zone_fallback = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] allow_compression_on_image_upload = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75622]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] allowed_direct_url_schemes = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] api_rate_limit = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] auth_strategy = keystone {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] az_cache_duration = 3600 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_availability_zone = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_host = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_stats_polling_interval = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backup_api_class = cinder.backup.api.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backup_name_template = backup-%s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backup_use_same_host = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backup_use_temp_snapshot = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] chap_password = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] chap_username = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_internal_tenant_project_id = d1848b6445574579a89fad8f7e9194eb {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_internal_tenant_user_id = d2212603a4874221a1e0bd462f6cd985 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cloned_volume_same_az = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cluster = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] compression_format = gzip {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] compute_api_class = cinder.compute.nova.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] config_dir = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] config_source = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] control_exchange = openstack {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] debug = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] default_availability_zone = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] default_group_type = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] default_volume_type = lvmdriver-1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] disk_geometry = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_client_cert = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_client_cert_key = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_data_namespace = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_ssl_cert_path = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_ssl_cert_verify = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] driver_use_ssl = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] enable_force_upload = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] enable_new_services = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] enable_unsupported_driver = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] enforce_multipath_for_image_xfer = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] filter_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_api_insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_api_ssl_compression = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_ca_certificates_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_catalog_info = image:glance:publicURL {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_num_retries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance_request_timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] goodness_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] graceful_shutdown_timeout = 5 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] group_api_class = cinder.group.api.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] host = devstack {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_compress_on_upload = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_conversion_address_space_limit = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_conversion_cpu_limit = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_conversion_disable = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_upload_use_cinder_backend = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_upload_use_internal_tenant = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_volume_cache_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_volume_cache_max_count = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] image_volume_cache_max_size_gb = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] init_host_max_objects_retrieval = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] instance_format = [instance: %(uuid)s] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iscsi_target_flags = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iscsi_write_cache = on {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iser_helper = tgtadm {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iser_ip_address = 192.168.122.185 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iser_port = 3260 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75622]: INFO cinder.volume.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_color = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_config_append = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_dir = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_options = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_rotate_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_rotate_interval_type = days {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] log_rotation_type = none {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] max_age = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] max_logfile_count = 30 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] max_logfile_size_mb = 200 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] max_over_subscription_ratio = 20.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] message_reap_interval = 86400 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] message_ttl = 2592000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] migration_create_volume_timeout_secs = 300 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] monkey_patch = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] monkey_patch_modules = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] my_ip = 192.168.122.185 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] no_snapshot_gb_quota = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] num_iser_scan_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] num_shell_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] num_volume_device_scan_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] nvmeof_conn_info_version = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] nvmet_ns_id = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] nvmet_port_id = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_max_limit = 1000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_ext_list = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_listen_port = 8776 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_use_ssl = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] osapi_volume_workers = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] per_volume_size_limit = -1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] periodic_fuzzy_delay = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] periodic_interval = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] public_endpoint = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] publish_errors = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_backup_gigabytes = 1000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_backups = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_gigabytes = 1000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_groups = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_snapshots = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] quota_volumes = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] rate_limit_burst = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] rate_limit_except_level = CRITICAL {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] rate_limit_interval = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] reinit_driver_count = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] replication_device = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] report_discard_supported = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] report_interval = 120 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] reservation_clean_interval = 86400 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] reservation_expire = 86400 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] reserved_image_namespaces = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] reserved_percentage = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] rpc_response_timeout = 120 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] run_external_periodic_tasks = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] scst_target_driver = iscsi {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] scst_target_iqn_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_down_time = 720 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] shell_completion = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] snapshot_name_template = snapshot-%s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] snapshot_same_host = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] split_loggers = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] state_path = /opt/stack/data/cinder {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] storage_availability_zone = nova {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] storage_protocol = iSCSI {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] syslog_log_facility = LOG_USER {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_helper = lioadm {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_ip_address = 192.168.122.185 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_port = 3260 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_protocol = iscsi {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] target_secondary_ip_addresses = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] trace_flags = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] transport_url = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] until_refresh = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_chap_auth = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_default_quota_class = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_journal = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_json = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_multipath_for_image_xfer = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_stderr = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] use_syslog = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] verify_glance_signatures = enabled {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_api_class = cinder.volume.api.API {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_backend_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_clear = zero {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_clear_ionice = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_clear_size = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_copy_bps_limit = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_dd_blocksize = 1M {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_name_template = volume-%s {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_service_inithost_offload = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volume_usage_audit_period = month {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] zoning_mode = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_concurrency.disable_process_locking = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.admin_password = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.admin_token = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.admin_user = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_admin_prefix = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_port = 35357 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_protocol = https {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_section = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_type = password {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_uri = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.auth_version = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.cache = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.identity_uri = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.include_service_catalog = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.interface = public {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_password = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcache_username = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.region_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.service_token_roles_required = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.service_type = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.backend = dogpile.cache.null {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.backend_argument = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.backend_expiration_time = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.config_prefix = cache.oslo {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.debug_cache_backend = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.enable_retry_client = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.enable_socket_keepalive = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.enforce_fips_mode = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.expiration_time = 600 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.hashclient_retry_attempts = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_dead_retry = 300 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_pool_maxsize = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_sasl_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.password = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.proxies = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.redis_db = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.redis_server = localhost:6379 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.retry_attempts = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.retry_delay = 0.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.socket_keepalive_count = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.socket_keepalive_idle = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.socket_keepalive_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.socket_timeout = 1.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.tls_allowed_ciphers = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.tls_cafile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.tls_certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.tls_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.tls_keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cache.username = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] coordination.backend_url = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.asyncio_connection = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.asyncio_slave_connection = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.backend = sqlalchemy {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.connection = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.connection_debug = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.connection_parameters = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.connection_recycle_time = 3600 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.connection_trace = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.db_inc_retry_interval = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.db_max_retries = 20 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.db_max_retry_interval = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.db_retry_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.max_overflow = 50 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.max_pool_size = 5 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.max_retries = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.mysql_wsrep_sync_wait = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.pool_timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.retry_interval = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.slave_connection = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.sqlite_synchronous = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.synchronous_reader = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] database.use_db_reconnect = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.connection_string = messaging:// {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.es_doc_type = notification {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.es_scroll_size = 10000 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.es_scroll_time = 2m {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.filter_error_trace = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.hmac_keys = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.sentinel_service_name = mymaster {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.socket_timeout = 0.1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.trace_requests = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler.trace_sqlalchemy = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler_jaeger.process_tags = {} {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler_jaeger.service_name_prefix = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] profiler_otlp.service_name_prefix = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.enforce_new_defaults = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: WARNING oslo_config.cfg [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.enforce_scope = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.policy_default_rule = default {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.policy_file = policy.yaml {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.group = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.helper_command = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack sudo[75626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] privsep_osbrick.user = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.group = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.helper_command = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack sudo[75626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] cinder_sys_admin.user = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.auth_section = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.auth_type = password {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.cafile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.collect_timing = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.send_service_user_token = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.split_loggers = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] service_user.timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.auth_section = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.auth_type = password {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.collect_timing = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.region_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.split_loggers = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] glance.timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.backend_availability_zone = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.chap_password = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.chap_username = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.disk_geometry = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_client_cert = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_client_cert_key = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_data_namespace = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.driver_use_ssl = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.extra_capabilities = {} {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.filter_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.goodness_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iscsi_target_flags = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iscsi_write_cache = on {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iser_helper = tgtadm {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iser_port = 3260 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.lvm_share_target = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.lvm_type = auto {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.num_shell_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.replication_device = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.report_discard_supported = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.reserved_percentage = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_helper = tgtadm {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_port = 3260 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_protocol = iscsi {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.trace_flags = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.unique_fqdn_network = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.use_chap_auth = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:39 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_backend_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_clear = zero {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_clear_ionice = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_clear_size = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_reports.file_event_handler = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_reports.log_dir = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.backend_host = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.chap_password = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.chap_username = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.disk_geometry = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_client_cert = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.extra_capabilities = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.filter_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.goodness_function = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iser_helper = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iser_ip_address = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iser_port = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.lvm_share_target = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.lvm_type = auto {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.num_shell_tries = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.replication_device = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.report_discard_supported = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.reserved_percentage = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.scst_target_driver = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.storage_protocol = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_helper = lioadm {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_ip_address = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_port = 3260 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.trace_flags = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.use_chap_auth = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_clear = zero {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_clear_size = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] lvmdriver-1.volumes_dir = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_notifications.driver = [] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_notifications.retry = -1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] key_manager.fixed_key = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.barbican_api_version = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.barbican_endpoint = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.barbican_endpoint_type = public {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.barbican_region_name = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.cafile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.collect_timing = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.number_of_retries = 60 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.retry_delay = 1 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.send_service_user_token = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.split_loggers = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.verify_ssl = True {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican.verify_ssl_path = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.auth_section = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.auth_type = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.cafile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.certfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.collect_timing = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.insecure = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.keyfile = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.split_loggers = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] barbican_service_user.timeout = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.approle_role_id = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.approle_secret_id = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.kv_mountpoint = secret {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.kv_path = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.kv_version = 2 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.namespace = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.root_token_id = **** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.ssl_ca_crt_file = None {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.timeout = 60.0 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.use_ssl = False {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:05:40 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] ******************************************************************************** {{(pid=75450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 16:05:40 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:40 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:40 devstack sudo[75626]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:40 devstack sudo[75746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:40 devstack sudo[75746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:41 devstack sudo[75746]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.659s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:05:41 devstack cinder-volume[75622]: INFO cinder.brick.local_dev.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:41 devstack sudo[75966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:41 devstack sudo[75966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:41 devstack sudo[75966]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG cinder.brick.local_dev.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75622) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 28 16:05:41 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:41 devstack sudo[76194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:41 devstack sudo[76194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:42 devstack sudo[76194]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:42 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.166s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:42 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:43 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:43 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:43 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:43 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:43 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 28 16:05:43 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:44 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:44 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.628s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:44 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:44 devstack sudo[76417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:44 devstack sudo[76417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:45 devstack sudo[76417]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:45 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:45 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:45 devstack sudo[76424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:45 devstack sudo[76424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:45 devstack sudo[76424]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:45 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:45 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:45 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:45 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:46 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:46 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:46 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:46 devstack sudo[76434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:46 devstack sudo[76434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:47 devstack sudo[76434]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:47 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:47 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:47 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:47 devstack cinder-volume[75622]: INFO cinder.volume.drivers.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:47 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:47 devstack sudo[76448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:47 devstack sudo[76448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:48 devstack sudo[76448]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:48 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.834s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:48 devstack cinder-volume[75622]: DEBUG cinder.volume.drivers.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Updating volume stats {{(pid=75622) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 16:05:48 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:48 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:48 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:49 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:49 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:49 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:49 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:49 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:49 devstack cinder-volume[75450]: DEBUG dbcounter [-] [75450] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:05:49 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:49 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:49 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:49 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:49 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:50 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:50 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:50 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:50 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:50 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:51 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:51 devstack cinder-volume[75622]: INFO cinder.volume.driver [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG cinder.volume.driver [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75622) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG oslo_db.sqlalchemy.engines [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG dbcounter [-] [75622] Writer thread running {{(pid=75622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG cinder.db.sqlalchemy.api [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Building query based on filter {{(pid=75622) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG cinder.image.image_utils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75622) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 16:05:51 devstack cinder-volume[75622]: INFO cinder.keymgr.migration [None req-172184d0-bbc6-4cda-80bc-fd937b01e976 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG cinder.volume.drivers.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Updating volume stats {{(pid=75622) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:51 devstack sudo[76729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:51 devstack sudo[76729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:51 devstack sudo[76729]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.573s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:51 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:51 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:51 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:52 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:52 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:52 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:53 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:53 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:53 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:53 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG cinder.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Notifying Schedulers of capabilities ... {{(pid=75622) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:05:53 devstack cinder-volume[75622]: INFO cinder.volume.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Driver initialization completed successfully. Apr 28 16:05:53 devstack cinder-volume[75622]: INFO cinder.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Initiating service 2 cleanup Apr 28 16:05:53 devstack cinder-volume[75622]: INFO cinder.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Service 2 cleanup completed. Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG cinder.service [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Creating RPC server for service cinder-volume {{(pid=75622) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG cinder.service [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75622) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 16:05:53 devstack cinder-volume[75622]: INFO cinder.volume.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG cinder.volume.drivers.lvm [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Updating volume stats {{(pid=75622) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 16:05:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:53 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:05:53 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:54 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:54 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:54 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:55 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:55 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:55 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:55 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:05:55 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:55 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:55 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:55 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:05:55 devstack sudo[76757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:05:55 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:05:56 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root Apr 28 16:05:56 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:05:56 devstack cinder-volume[75622]: INFO cinder.volume.manager [None req-a920e390-4ec5-4e29-93c2-8e0f74c64507 None None] Driver post RPC initialization completed successfully. Apr 28 16:06:06 devstack cinder-volume[75622]: DEBUG dbcounter [-] [75622] Writing DB stats cinder:SELECT=4 {{(pid=75622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:06:06 devstack cinder-volume[75622]: DEBUG dbcounter [-] [75622] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:06:52 devstack cinder-volume[75622]: DEBUG oslo_service.periodic_task [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75622) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:06:52 devstack cinder-volume[75622]: DEBUG cinder.volume.drivers.lvm [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Updating volume stats {{(pid=75622) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 16:06:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:06:52 devstack sudo[78734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:06:52 devstack sudo[78734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:06:52 devstack sudo[78734]: pam_unix(sudo:session): session closed for user root Apr 28 16:06:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:06:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:06:52 devstack sudo[78737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:06:52 devstack sudo[78737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:06:53 devstack sudo[78737]: pam_unix(sudo:session): session closed for user root Apr 28 16:06:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:06:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:06:53 devstack sudo[78756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:06:53 devstack sudo[78756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:06:54 devstack sudo[78756]: pam_unix(sudo:session): session closed for user root Apr 28 16:06:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.578s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:06:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:06:54 devstack sudo[78761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:06:54 devstack sudo[78761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:06:54 devstack sudo[78761]: pam_unix(sudo:session): session closed for user root Apr 28 16:06:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:06:54 devstack cinder-volume[75622]: DEBUG cinder.manager [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Notifying Schedulers of capabilities ... {{(pid=75622) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:07:52 devstack cinder-volume[75622]: DEBUG oslo_service.periodic_task [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75622) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:07:52 devstack cinder-volume[75622]: DEBUG cinder.volume.drivers.lvm [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Updating volume stats {{(pid=75622) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 16:07:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:07:52 devstack sudo[81903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 16:07:52 devstack sudo[81903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:07:52 devstack sudo[81903]: pam_unix(sudo:session): session closed for user root Apr 28 16:07:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:07:52 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:07:52 devstack sudo[81906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:07:52 devstack sudo[81906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:07:53 devstack sudo[81906]: pam_unix(sudo:session): session closed for user root Apr 28 16:07:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:07:53 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:07:53 devstack sudo[81909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 16:07:53 devstack sudo[81909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:07:54 devstack sudo[81909]: pam_unix(sudo:session): session closed for user root Apr 28 16:07:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.571s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:07:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:07:54 devstack sudo[81913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 16:07:54 devstack sudo[81913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:07:54 devstack sudo[81913]: pam_unix(sudo:session): session closed for user root Apr 28 16:07:54 devstack cinder-volume[75622]: DEBUG oslo_concurrency.processutils [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:07:54 devstack cinder-volume[75622]: DEBUG cinder.manager [None req-c6243e6d-6f97-478c-af28-b529bdc9b7b6 None None] Notifying Schedulers of capabilities ... {{(pid=75622) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:08:06 devstack cinder-volume[75622]: DEBUG dbcounter [-] [75622] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:08:38 devstack cinder-volume[75450]: INFO oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Caught SIGTERM, stopping children Apr 28 16:08:38 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Acquiring lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:08:38 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Acquired lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:08:38 devstack cinder-volume[75450]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Releasing lock "singleton_lock" {{(pid=75450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:08:38 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Stop services. {{(pid=75450) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 16:08:38 devstack cinder-volume[75450]: DEBUG oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Killing children. {{(pid=75450) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 16:08:38 devstack cinder-volume[75450]: INFO oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Waiting on 1 children to exit Apr 28 16:08:38 devstack cinder-volume[75622]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Acquiring lock "singleton_lock" {{(pid=75622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:08:38 devstack cinder-volume[75622]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Acquired lock "singleton_lock" {{(pid=75622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:08:38 devstack cinder-volume[75622]: DEBUG oslo_concurrency.lockutils [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Releasing lock "singleton_lock" {{(pid=75622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:08:38 devstack cinder-volume[75622]: WARNING amqp [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 16:08:38 devstack cinder-volume[75622]: WARNING amqp [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 16:08:38 devstack cinder-volume[75450]: INFO oslo_service.backend._eventlet.service [None req-5071682f-d69f-4005-9251-4e192c2be43a None None] Child 75622 exited with status 0 Apr 28 16:08:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:08:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:08:41 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:08:42 devstack cinder-volume[83289]: INFO dbcounter [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Registered counter for database cinder Apr 28 16:08:42 devstack cinder-volume[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:08:42 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writer thread running {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:08:42 devstack cinder-volume[83289]: INFO cinder.rpc [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 16:08:42 devstack cinder-volume[83289]: INFO cinder.rpc [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 16:08:42 devstack cinder-volume[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:08:42 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Determined volume DB was empty at startup. Apr 28 16:08:42 devstack cinder-volume[83289]: DEBUG cinder.volume.manager [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83289) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 16:08:42 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 16:08:42 devstack cinder-volume[83289]: WARNING stevedore.named [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 16:08:42 devstack cinder-volume[83289]: WARNING castellan.key_manager [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:08:42 devstack cinder-volume[83289]: WARNING cinder.keymgr.conf_key_mgr [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:08:42 devstack cinder-volume[83289]: INFO cinder.volume.manager [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 16:08:42 devstack cinder-volume[83289]: DEBUG oslo_db.sqlalchemy.engines [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:08:43 devstack cinder-volume[83289]: INFO oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Starting 1 workers Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Started child 83571 {{(pid=83289) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Full set of CONF: {{(pid=83289) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] ******************************************************************************** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Configuration options gathered from: {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 16:08:43 devstack cinder-volume[83571]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] ================================================================================ {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] allow_availability_zone_fallback = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] allow_compression_on_image_upload = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] allowed_direct_url_schemes = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] api_rate_limit = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] auth_strategy = keystone {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_availability_zone = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_host = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_stats_polling_interval = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backup_api_class = cinder.backup.api.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backup_name_template = backup-%s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backup_use_same_host = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backup_use_temp_snapshot = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] chap_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] chap_username = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_internal_tenant_project_id = d1848b6445574579a89fad8f7e9194eb {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_internal_tenant_user_id = d2212603a4874221a1e0bd462f6cd985 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cluster = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] compression_format = gzip {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] compute_api_class = cinder.compute.nova.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] config_dir = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] config_source = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] control_exchange = openstack {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] debug = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] default_availability_zone = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] default_group_type = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] default_volume_type = QuobyteHD {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] disk_geometry = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_client_cert = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_client_cert_key = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_data_namespace = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_ssl_cert_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_ssl_cert_verify = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] driver_use_ssl = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] enable_new_services = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] enable_unsupported_driver = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] enabled_backends = ['QuobyteHD'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] enforce_multipath_for_image_xfer = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] filter_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_api_insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_api_ssl_compression = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_ca_certificates_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83571]: INFO cinder.volume.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_catalog_info = image:glance:publicURL {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.remotefs [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83571) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_num_retries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance_request_timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] goodness_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] graceful_shutdown_timeout = 5 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] group_api_class = cinder.group.api.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] host = devstack {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_compress_on_upload = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_conversion_address_space_limit = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_conversion_cpu_limit = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_conversion_disable = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_upload_use_cinder_backend = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_upload_use_internal_tenant = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_volume_cache_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_volume_cache_max_count = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] image_volume_cache_max_size_gb = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] init_host_max_objects_retrieval = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] instance_format = [instance: %(uuid)s] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iscsi_target_flags = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iscsi_write_cache = on {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iser_helper = tgtadm {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iser_ip_address = 192.168.122.185 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iser_port = 3260 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_color = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_config_append = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_dir = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_options = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_rotate_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_rotate_interval_type = days {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] log_rotation_type = none {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] max_age = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] max_logfile_count = 30 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] max_logfile_size_mb = 200 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] max_over_subscription_ratio = 20.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] message_reap_interval = 86400 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] message_ttl = 2592000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] migration_create_volume_timeout_secs = 300 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] monkey_patch = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] monkey_patch_modules = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] my_ip = 192.168.122.185 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] no_snapshot_gb_quota = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] num_iser_scan_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] num_shell_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] num_volume_device_scan_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] nvmeof_conn_info_version = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] nvmet_ns_id = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] nvmet_port_id = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_max_limit = 1000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_ext_list = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_listen_port = 8776 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_use_ssl = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] osapi_volume_workers = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] per_volume_size_limit = -1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] periodic_fuzzy_delay = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] periodic_interval = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] public_endpoint = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] publish_errors = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_backup_gigabytes = 1000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_backups = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_gigabytes = 1000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_groups = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_snapshots = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] quota_volumes = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] rate_limit_burst = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] rate_limit_except_level = CRITICAL {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] rate_limit_interval = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] reinit_driver_count = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] replication_device = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] report_discard_supported = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] report_interval = 120 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] reservation_clean_interval = 86400 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] reservation_expire = 86400 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] reserved_image_namespaces = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] reserved_percentage = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] rpc_response_timeout = 120 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] run_external_periodic_tasks = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] scst_target_driver = iscsi {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] scst_target_iqn_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_down_time = 720 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] shell_completion = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] snapshot_name_template = snapshot-%s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] split_loggers = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] state_path = /opt/stack/data/cinder {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] storage_availability_zone = nova {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] storage_protocol = iSCSI {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] syslog_log_facility = LOG_USER {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_helper = lioadm {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_ip_address = 192.168.122.185 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_port = 3260 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_protocol = iscsi {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] target_secondary_ip_addresses = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] trace_flags = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] transport_url = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] until_refresh = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_chap_auth = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_default_quota_class = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_journal = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_json = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_multipath_for_image_xfer = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_stderr = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] use_syslog = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] verify_glance_signatures = enabled {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_api_class = cinder.volume.api.API {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_backend_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_clear = zero {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_clear_ionice = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_clear_size = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_copy_bps_limit = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_dd_blocksize = 1M {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_name_template = volume-%s {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_service_inithost_offload = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volume_usage_audit_period = month {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] zoning_mode = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_concurrency.disable_process_locking = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.admin_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.admin_token = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.admin_user = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83571) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 16:08:43 devstack cinder-volume[83571]: WARNING cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 16:08:43 devstack cinder-volume[83571]: WARNING cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_port = 35357 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_protocol = https {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_section = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_type = password {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_uri = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.auth_version = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Running cmd (subprocess): mount.quobyte {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.cache = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.identity_uri = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.include_service_catalog = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.interface = public {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_password = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcache_username = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.region_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.service_type = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.backend = dogpile.cache.null {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.backend_argument = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.backend_expiration_time = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.config_prefix = cache.oslo {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.debug_cache_backend = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.enable_retry_client = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.enable_socket_keepalive = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.enforce_fips_mode = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.expiration_time = 600 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.hashclient_retry_attempts = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_dead_retry = 300 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_pool_maxsize = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_sasl_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.proxies = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.redis_db = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.redis_server = localhost:6379 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.retry_attempts = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.retry_delay = 0.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.socket_keepalive_count = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.socket_keepalive_idle = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.socket_keepalive_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.socket_timeout = 1.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.tls_allowed_ciphers = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.tls_cafile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.tls_certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.tls_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.tls_keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cache.username = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] coordination.backend_url = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.asyncio_connection = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.asyncio_slave_connection = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.backend = sqlalchemy {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.connection = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.connection_debug = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.connection_parameters = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.connection_recycle_time = 3600 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.connection_trace = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.db_inc_retry_interval = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.db_max_retries = 20 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.db_max_retry_interval = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.db_retry_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.max_overflow = 50 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.max_pool_size = 5 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.max_retries = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.mysql_wsrep_sync_wait = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.pool_timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.retry_interval = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.slave_connection = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.sqlite_synchronous = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.synchronous_reader = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] database.use_db_reconnect = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.connection_string = messaging:// {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.es_doc_type = notification {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.es_scroll_size = 10000 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.es_scroll_time = 2m {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.filter_error_trace = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.hmac_keys = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.sentinel_service_name = mymaster {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.socket_timeout = 0.1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.trace_requests = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler.trace_sqlalchemy = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler_jaeger.process_tags = {} {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler_jaeger.service_name_prefix = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] profiler_otlp.service_name_prefix = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.enforce_new_defaults = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: WARNING oslo_config.cfg [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.enforce_scope = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.policy_default_rule = default {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.policy_file = policy.yaml {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.group = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.helper_command = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] privsep_osbrick.user = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.group = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.helper_command = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] cinder_sys_admin.user = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.auth_section = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.auth_type = password {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.cafile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.collect_timing = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.send_service_user_token = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.split_loggers = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] service_user.timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.auth_section = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.auth_type = password {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.collect_timing = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.region_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.split_loggers = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] glance.timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.backend_availability_zone = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.chap_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.chap_username = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.disk_geometry = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_client_cert = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_client_cert_key = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_data_namespace = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.driver_use_ssl = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.extra_capabilities = {} {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.filter_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.goodness_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iscsi_target_flags = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iscsi_write_cache = on {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iser_helper = tgtadm {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iser_port = 3260 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_host = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_login = admin {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_mount_options = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_private_key = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_share_path = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.num_shell_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.quobyte_volume_url = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.replication_device = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.report_discard_supported = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.reserved_percentage = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_helper = tgtadm {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_port = 3260 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_protocol = iscsi {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.trace_flags = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.unique_fqdn_network = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.use_chap_auth = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_backend_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_clear = zero {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_clear_ionice = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_clear_size = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_reports.file_event_handler = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_reports.log_dir = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.backend_availability_zone = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.backend_host = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.chap_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.chap_username = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.chiscsi_conf = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.disk_geometry = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_client_cert = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_data_namespace = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.driver_use_ssl = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.extra_capabilities = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.filter_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.goodness_function = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack quobyte-client[83576]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iser_helper = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack quobyte-client[83576]: Invalid parameters found, error: missing mount point. Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iser_ip_address = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iser_port = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.iser_target_prefix = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_host = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_login = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_mount_options = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack quobyte-client[83576]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_password = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_private_key = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_share_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_ssh_port = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack quobyte-client[83576]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.num_shell_tries = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.nvmet_port_id = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.replication_device = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.report_discard_supported = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.reserved_percentage = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.scst_target_driver = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.storage_protocol = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_helper = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_ip_address = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_port = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_prefix = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_protocol = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.trace_flags = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.use_chap_auth = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_clear = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_clear_size = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] QuobyteHD.volumes_dir = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack sudo[83578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f -c /etc/quobyte/client-cinder.cfg Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] CMD "mount.quobyte" returned: 1 in 0.169s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_notifications.driver = [] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_notifications.retry = -1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=83571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] key_manager.fixed_key = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.barbican_api_version = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.barbican_endpoint = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.barbican_endpoint_type = public {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.barbican_region_name = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.cafile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.collect_timing = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: INFO cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 ... Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.number_of_retries = 60 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.retry_delay = 1 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.send_service_user_token = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.split_loggers = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f -c /etc/quobyte/client-cinder.cfg {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.verify_ssl = True {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican.verify_ssl_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.auth_section = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.auth_type = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.cafile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.certfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.collect_timing = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.insecure = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.keyfile = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.split_loggers = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] barbican_service_user.timeout = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.approle_role_id = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.approle_secret_id = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.kv_mountpoint = secret {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.kv_path = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.kv_version = 2 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.namespace = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.root_token_id = **** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.ssl_ca_crt_file = None {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.timeout = 60.0 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.use_ssl = False {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:08:43 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] ******************************************************************************** {{(pid=83289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 16:08:44 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.772s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:44 devstack cinder-volume[83571]: INFO cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 succeeded Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=83571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.790s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:44 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:08:44 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:08:44 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.602s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:44 devstack cinder-volume[83571]: INFO cinder.volume.driver [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Driver hasn't implemented _init_vendor_properties() Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.volume.driver [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6303215026855, 'free_capacity_gb': 1775.6303215026855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83571) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_db.sqlalchemy.engines [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83571) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG dbcounter [-] [83571] Writer thread running {{(pid=83571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.db.sqlalchemy.api [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Building query based on filter {{(pid=83571) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.image.image_utils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83571) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 16:08:44 devstack cinder-volume[83571]: INFO cinder.keymgr.migration [None req-5f5e776f-5721-4cca-907b-adb32795a603 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=83571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=83571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:08:44 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:44 devstack sudo[83681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:08:44 devstack sudo[83681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:08:45 devstack sudo[83681]: pam_unix(sudo:session): session closed for user root Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.580s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG cinder.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Notifying Schedulers of capabilities ... {{(pid=83571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:08:45 devstack cinder-volume[83571]: INFO cinder.volume.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Driver initialization completed successfully. Apr 28 16:08:45 devstack cinder-volume[83571]: INFO cinder.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Initiating service 3 cleanup Apr 28 16:08:45 devstack cinder-volume[83571]: INFO cinder.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Service 3 cleanup completed. Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG cinder.service [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Creating RPC server for service cinder-volume {{(pid=83571) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG cinder.service [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83571) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 16:08:45 devstack cinder-volume[83571]: INFO cinder.volume.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=83571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=83571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:08:45 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:45 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:08:45 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:08:46 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 28 16:08:46 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.800s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:46 devstack cinder-volume[83571]: INFO cinder.volume.manager [None req-7b3589a3-ebfa-40d9-9f92-f44fe15cd463 None None] Driver post RPC initialization completed successfully. Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=83571) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG cinder.volume.drivers.quobyte [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=83571) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83571) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:08:50 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:08:50 devstack sudo[83854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:08:50 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:08:51 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root Apr 28 16:08:51 devstack cinder-volume[83571]: DEBUG oslo_concurrency.processutils [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.545s {{(pid=83571) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:08:51 devstack cinder-volume[83571]: DEBUG cinder.manager [None req-65a05912-85d1-4742-9e63-e57650880d7b None None] Notifying Schedulers of capabilities ... {{(pid=83571) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG dbcounter [-] [83289] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:08:53 devstack cinder-volume[83289]: INFO oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Caught SIGTERM, stopping children Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Acquiring lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Acquired lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Releasing lock "singleton_lock" {{(pid=83289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Stop services. {{(pid=83289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 16:08:53 devstack cinder-volume[83289]: DEBUG oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Killing children. {{(pid=83289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 16:08:53 devstack cinder-volume[83289]: INFO oslo_service.backend._eventlet.service [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Waiting on 1 children to exit Apr 28 16:08:56 devstack cinder-volume[83571]: DEBUG dbcounter [-] [83571] Writing DB stats cinder:SELECT=3 {{(pid=83571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:08:56 devstack cinder-volume[83571]: DEBUG dbcounter [-] [83571] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83571) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:08:58 devstack cinder-volume[83571]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 28 16:08:58 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Acquiring lock "singleton_lock" {{(pid=83571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:08:58 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Acquired lock "singleton_lock" {{(pid=83571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:08:58 devstack cinder-volume[83571]: DEBUG oslo_concurrency.lockutils [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Releasing lock "singleton_lock" {{(pid=83571) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:08:58 devstack cinder-volume[83571]: WARNING amqp [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 16:08:58 devstack cinder-volume[83571]: WARNING amqp [None req-81fe0b55-9c1d-4338-bff7-bc2b4f4d0871 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 16:09:01 devstack cinder-volume[83932]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 16:09:01 devstack cinder-volume[83932]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 16:09:01 devstack cinder-volume[83932]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83932) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 16:09:01 devstack cinder-volume[83932]: INFO dbcounter [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Registered counter for database cinder Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_db.sqlalchemy.engines [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG dbcounter [-] [83932] Writer thread running {{(pid=83932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:09:02 devstack cinder-volume[83932]: INFO cinder.rpc [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 16:09:02 devstack cinder-volume[83932]: INFO cinder.rpc [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_db.sqlalchemy.engines [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:09:02 devstack cinder-volume[83932]: INFO cinder.volume.manager [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Determined volume DB was empty at startup. Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG cinder.volume.manager [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83932) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 16:09:02 devstack cinder-volume[83932]: WARNING stevedore.named [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 16:09:02 devstack cinder-volume[83932]: WARNING castellan.key_manager [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:09:02 devstack cinder-volume[83932]: WARNING cinder.keymgr.conf_key_mgr [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 16:09:02 devstack cinder-volume[83932]: INFO cinder.volume.manager [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_db.sqlalchemy.engines [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83932) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:09:02 devstack cinder-volume[83932]: INFO oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Starting 1 workers Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Started child 84171 {{(pid=83932) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Full set of CONF: {{(pid=83932) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] ******************************************************************************** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Configuration options gathered from: {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] ================================================================================ {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] allow_availability_zone_fallback = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] allow_compression_on_image_upload = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] allowed_direct_url_schemes = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] api_rate_limit = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] auth_strategy = keystone {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_availability_zone = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_host = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_stats_polling_interval = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backup_api_class = cinder.backup.api.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backup_name_template = backup-%s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backup_use_same_host = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backup_use_temp_snapshot = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[84171]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] chap_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] chap_username = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_internal_tenant_project_id = d1848b6445574579a89fad8f7e9194eb {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_internal_tenant_user_id = d2212603a4874221a1e0bd462f6cd985 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cluster = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] compression_format = gzip {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] compute_api_class = cinder.compute.nova.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] config_dir = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] config_source = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] control_exchange = openstack {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] debug = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] default_availability_zone = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] default_group_type = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] default_volume_type = QuobyteHD {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] disk_geometry = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_client_cert = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_client_cert_key = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_data_namespace = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_ssl_cert_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_ssl_cert_verify = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] driver_use_ssl = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] enable_new_services = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] enable_unsupported_driver = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] enabled_backends = ['QuobyteHD'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] enforce_multipath_for_image_xfer = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] filter_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_api_insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_api_servers = ['http://192.168.122.185/image'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_api_ssl_compression = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_ca_certificates_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_catalog_info = image:glance:publicURL {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_num_retries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance_request_timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] goodness_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] graceful_shutdown_timeout = 5 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] group_api_class = cinder.group.api.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] host = devstack {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_compress_on_upload = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_conversion_address_space_limit = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_conversion_cpu_limit = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_conversion_disable = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_upload_use_cinder_backend = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_upload_use_internal_tenant = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_volume_cache_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_volume_cache_max_count = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] image_volume_cache_max_size_gb = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] init_host_max_objects_retrieval = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] instance_format = [instance: %(uuid)s] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iscsi_target_flags = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iscsi_write_cache = on {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iser_helper = tgtadm {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iser_ip_address = 192.168.122.185 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iser_port = 3260 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_color = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_config_append = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_dir = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_options = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_rotate_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_rotate_interval_type = days {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] log_rotation_type = none {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] max_age = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] max_logfile_count = 30 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] max_logfile_size_mb = 200 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] max_over_subscription_ratio = 20.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] message_reap_interval = 86400 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] message_ttl = 2592000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] migration_create_volume_timeout_secs = 300 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] monkey_patch = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] monkey_patch_modules = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] my_ip = 192.168.122.185 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] no_snapshot_gb_quota = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] num_iser_scan_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] num_shell_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] num_volume_device_scan_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] nvmeof_conn_info_version = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] nvmet_ns_id = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] nvmet_port_id = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_max_limit = 1000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_ext_list = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_listen = 0.0.0.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_listen_port = 8776 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_use_ssl = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] osapi_volume_workers = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] per_volume_size_limit = -1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] periodic_fuzzy_delay = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] periodic_interval = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] project_id_regex = [0-9a-f\-]+ {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] public_endpoint = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] publish_errors = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_backup_gigabytes = 1000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_backups = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_gigabytes = 1000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_groups = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_snapshots = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] quota_volumes = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] rate_limit_burst = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] rate_limit_except_level = CRITICAL {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] rate_limit_interval = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] reinit_driver_count = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] replication_device = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] report_discard_supported = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] report_interval = 120 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] reservation_clean_interval = 86400 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] reservation_expire = 86400 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] reserved_image_namespaces = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] reserved_percentage = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] rpc_response_timeout = 120 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] run_external_periodic_tasks = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] scst_target_driver = iscsi {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] scst_target_iqn_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_down_time = 720 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] shell_completion = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] snapshot_name_template = snapshot-%s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] split_loggers = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] state_path = /opt/stack/data/cinder {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] storage_availability_zone = nova {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] storage_protocol = iSCSI {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] syslog_log_facility = LOG_USER {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_helper = lioadm {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_ip_address = 192.168.122.185 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_port = 3260 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_protocol = iscsi {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] target_secondary_ip_addresses = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] trace_flags = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] transfer_api_class = cinder.transfer.api.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] transport_url = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] until_refresh = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_chap_auth = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_default_quota_class = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_journal = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_json = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_multipath_for_image_xfer = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_stderr = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] use_syslog = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] verify_glance_signatures = enabled {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_api_class = cinder.volume.api.API {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_backend_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_clear = zero {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_clear_ionice = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_clear_size = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84171) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_copy_bps_limit = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_dd_blocksize = 1M {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_name_template = volume-%s {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_service_inithost_offload = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volume_usage_audit_period = month {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] zoning_mode = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_concurrency.disable_process_locking = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.admin_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.admin_token = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.admin_user = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_admin_prefix = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_port = 35357 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_protocol = https {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_section = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_type = password {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_uri = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.auth_version = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.cache = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.delay_auth_decision = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.http_connect_timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.identity_uri = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.include_service_catalog = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.interface = public {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_password = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcache_username = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.region_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.service_token_roles_required = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.service_type = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.token_cache_time = 300 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.backend = dogpile.cache.null {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.backend_argument = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.backend_expiration_time = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.config_prefix = cache.oslo {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.debug_cache_backend = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.enable_retry_client = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.enable_socket_keepalive = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.enforce_fips_mode = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.expiration_time = 600 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.hashclient_retry_attempts = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_dead_retry = 300 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_pool_maxsize = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_sasl_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.proxies = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.redis_db = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.redis_sentinel_service_name = mymaster {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.redis_server = localhost:6379 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.retry_attempts = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.retry_delay = 0.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.socket_keepalive_count = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.socket_keepalive_idle = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.socket_keepalive_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.socket_timeout = 1.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.tls_allowed_ciphers = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.tls_cafile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.tls_certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.tls_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.tls_keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cache.username = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] coordination.backend_url = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.asyncio_connection = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.asyncio_slave_connection = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.backend = sqlalchemy {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.connection = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.connection_debug = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.connection_parameters = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.connection_recycle_time = 3600 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.connection_trace = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.db_inc_retry_interval = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.db_max_retries = 20 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.db_max_retry_interval = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.db_retry_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.max_overflow = 50 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.max_pool_size = 5 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.max_retries = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.mysql_wsrep_sync_wait = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.pool_timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.retry_interval = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.slave_connection = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.sqlite_synchronous = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.synchronous_reader = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] database.use_db_reconnect = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.connection_string = messaging:// {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.es_doc_type = notification {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.es_scroll_size = 10000 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.es_scroll_time = 2m {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.filter_error_trace = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.hmac_keys = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.sentinel_service_name = mymaster {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.socket_timeout = 0.1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.trace_requests = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler.trace_sqlalchemy = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler_jaeger.process_tags = {} {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler_jaeger.service_name_prefix = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] profiler_otlp.service_name_prefix = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.enforce_new_defaults = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: WARNING oslo_config.cfg [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.enforce_scope = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.policy_default_rule = default {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.policy_file = policy.yaml {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_policy.remote_timeout = 60.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.group = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.helper_command = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] privsep_osbrick.user = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.group = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.helper_command = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] cinder_sys_admin.user = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.auth_section = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.auth_type = password {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.cafile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.collect_timing = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.send_service_user_token = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.split_loggers = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] service_user.timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.auth_section = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.auth_type = password {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.collect_timing = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.region_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.split_loggers = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] glance.timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.backend_availability_zone = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.chap_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.chap_username = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.disk_geometry = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_client_cert = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_client_cert_key = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_data_namespace = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.driver_use_ssl = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.enable_unsupported_driver = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.extra_capabilities = {} {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.filter_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.goodness_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iscsi_target_flags = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iscsi_write_cache = on {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iser_helper = tgtadm {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iser_port = 3260 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_host = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_login = admin {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_mount_options = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_private_key = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_share_path = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_ssh_port = 22 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.num_shell_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.nvmet_port_id = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_client_cfg = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.quobyte_volume_url = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.replication_device = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.report_discard_supported = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.reserved_percentage = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.scst_target_driver = iscsi {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.scst_target_iqn_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.storage_protocol = iSCSI {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_helper = tgtadm {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_port = 3260 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_protocol = iscsi {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.trace_flags = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.unique_fqdn_network = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.use_chap_auth = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_backend_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_clear = zero {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_clear_ionice = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_clear_size = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_reports.file_event_handler = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_reports.log_dir = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.backend_availability_zone = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.backend_host = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.chap_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.chap_username = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.chiscsi_conf = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.disk_geometry = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_client_cert = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_client_cert_key = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_data_namespace = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.driver_use_ssl = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.extra_capabilities = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.filter_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.goodness_function = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iscsi_target_flags = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iscsi_write_cache = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iser_helper = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iser_ip_address = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iser_port = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.iser_target_prefix = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84171) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 16:09:02 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 16:09:02 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_host = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_login = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_mount_options = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_password = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_private_key = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_share_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_ssh_port = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.num_shell_tries = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Running cmd (subprocess): mount.quobyte {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nvmet_ns_id = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.nvmet_port_id = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.replication_device = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.report_discard_supported = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.reserved_percentage = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.scst_target_driver = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.storage_protocol = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_helper = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_ip_address = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_port = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_prefix = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_protocol = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.trace_flags = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.unique_fqdn_network = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.use_chap_auth = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_clear = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_clear_ionice = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_clear_size = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] QuobyteHD.volumes_dir = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.ssl_version = {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_notifications.driver = [] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_notifications.retry = -1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] oslo_messaging_notifications.transport_url = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] key_manager.fixed_key = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.barbican_api_version = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.barbican_endpoint = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.barbican_endpoint_type = public {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.barbican_region_name = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.cafile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.collect_timing = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.number_of_retries = 60 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.retry_delay = 1 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.send_service_user_token = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.split_loggers = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.verify_ssl = True {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican.verify_ssl_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.auth_section = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.auth_type = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.cafile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.certfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.collect_timing = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.insecure = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.keyfile = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.split_loggers = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] barbican_service_user.timeout = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.approle_role_id = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.approle_secret_id = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.kv_mountpoint = secret {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.kv_path = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.kv_version = 2 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.namespace = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.root_token_id = **** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.ssl_ca_crt_file = None {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.timeout = 60.0 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.use_ssl = False {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 28 16:09:02 devstack cinder-volume[83932]: DEBUG oslo_service.backend._eventlet.service [None req-ec59017f-91ff-45c8-ab33-7578e43bcb6f None None] ******************************************************************************** {{(pid=83932) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 28 16:09:02 devstack quobyte-client[84173]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 16:09:02 devstack quobyte-client[84173]: Invalid parameters found, error: missing mount point. Apr 28 16:09:02 devstack quobyte-client[84173]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 16:09:02 devstack quobyte-client[84173]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:09:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:09:02 devstack sudo[84177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:09:02 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:09:03 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.559s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.volume.driver [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Driver hasn't implemented _init_vendor_properties() Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.volume.driver [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6303215026855, 'free_capacity_gb': 1775.6303215026855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84171) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_db.sqlalchemy.engines [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writer thread running {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.db.sqlalchemy.api [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Building query based on filter {{(pid=84171) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84171) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.keymgr.migration [None req-8ac52977-6afe-4710-b046-62454cf536e8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 16:09:03 devstack sudo[84182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:09:03 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:09:03 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.583s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Driver initialization completed successfully. Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Initiating service 3 cleanup Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Service 3 cleanup completed. Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.service [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Creating RPC server for service cinder-volume {{(pid=84171) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.service [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84171) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 16:09:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:09:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:09:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:09:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:09:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:09:04 devstack sudo[84190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:09:04 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:09:04 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root Apr 28 16:09:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.549s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:09:04 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-26350abf-19ab-40ce-a02c-cbed4731cf2f None None] Driver post RPC initialization completed successfully. Apr 28 16:09:12 devstack cinder-volume[83932]: DEBUG dbcounter [-] [83932] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83932) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:09:13 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=2 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:09:14 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Flow 'volume_create_manager' (2d395668-6673-428e-9e50-bc78f4c7b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef61705-4202-4fe3-8667-5a45776da6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef61705-4202-4fe3-8667-5a45776da6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1652700752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cbf6d33ed94776809dfe1adcf0a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:27Z,use_quota=True,user_id='89d22880765e4e5caa8d6c206ad881c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa9d11f-c58d-409d-b465-e5bc013ea708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa9d11f-c58d-409d-b465-e5bc013ea708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041eced1-ff57-4205-b13e-dca7647e621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041eced1-ff57-4205-b13e-dca7647e621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a', 'volume_name': 'volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca40498-9881-4402-a2f2-7d42eff6c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca40498-9881-4402-a2f2-7d42eff6c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfff63c-4e29-4fe7-a685-48b61b5792ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:26 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Volume 68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a', 'volume_size': 1} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1652700752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cbf6d33ed94776809dfe1adcf0a13d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:27Z,use_quota=True,user_id='89d22880765e4e5caa8d6c206ad881c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Creating volume 68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:10:26 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:10:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:26 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a 1073741824 Apr 28 16:10:26 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Flow 'volume_create_manager' (002d9dc3-f2d2-47ac-a39e-889b9607e6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26f7682-dbd9-4478-b5db-75874f8fa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26f7682-dbd9-4478-b5db-75874f8fa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1777274895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c0fc0a-3215-457b-ad3b-92697181b0c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5a4fe260e7747b6999609b2df2c194b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:27Z,use_quota=True,user_id='bc8912b2b5c34d55801c712e072bc4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e587e30-f113-48a8-859c-553ef2e18c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e587e30-f113-48a8-859c-553ef2e18c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6993eef-5ae8-4b44-8ce0-c3c458f63455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6993eef-5ae8-4b44-8ce0-c3c458f63455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c0fc0a-3215-457b-ad3b-92697181b0c9', 'volume_name': 'volume-60c0fc0a-3215-457b-ad3b-92697181b0c9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98c86ea-2896-4d04-b0eb-a930206247fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98c86ea-2896-4d04-b0eb-a930206247fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbefd62-69c9-46ba-8054-08ca4df1c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Volume 60c0fc0a-3215-457b-ad3b-92697181b0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c0fc0a-3215-457b-ad3b-92697181b0c9', 'volume_size': 1} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:27 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a 1073741824" returned: 0 in 1.003s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:27 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a Apr 28 16:10:27 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:28 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" returned: 0 in 1.179s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:10:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1777274895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c0fc0a-3215-457b-ad3b-92697181b0c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5a4fe260e7747b6999609b2df2c194b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:27Z,use_quota=True,user_id='bc8912b2b5c34d55801c712e072bc4d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Creating volume 60c0fc0a-3215-457b-ad3b-92697181b0c9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:10:29 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:29 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 1073741824 Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfff63c-4e29-4fe7-a685-48b61b5792ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:29 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af70a084-59ce-4a40-b2e2-3ed9f7ff03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:29 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Volume volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a (68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a): created successfully Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af70a084-59ce-4a40-b2e2-3ed9f7ff03a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Flow 'volume_create_manager' (2d395668-6673-428e-9e50-bc78f4c7b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a7717936-de42-40ea-9ac7-1fb86cf33def tempest-VolumesAdminNegativeTest-1215073220 None] Created volume successfully. Apr 28 16:10:30 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 1073741824" returned: 0 in 1.083s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:30 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 Apr 28 16:10:30 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Acquiring lock "cinder-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "cinder-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Acquiring lock "cinder-quobyte-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:10:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "cinder-quobyte-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" acquired by "delete_volume" :: waited 0.049s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:10:30 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjzwhwhts/privsep.sock'] Apr 28 16:10:30 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjzwhwhts/privsep.sock Apr 28 16:10:30 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:31 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9" returned: 0 in 1.554s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] <== create_volume: return (2699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.706s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbefd62-69c9-46ba-8054-08ca4df1c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c0fc0a-3215-457b-ad3b-92697181b0c9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c628643-148a-44bc-91b4-c7f2a670cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:31 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Volume volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 (60c0fc0a-3215-457b-ad3b-92697181b0c9): created successfully Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c628643-148a-44bc-91b4-c7f2a670cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Flow 'volume_create_manager' (002d9dc3-f2d2-47ac-a39e-889b9607e6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:31 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-8db18e31-5e8e-491d-9d40-69048d921529 req-0033c206-4fca-47b7-b7d7-ea8f704bf14e tempest-VolumesGetTestJSON-1431760446 None] Created volume successfully. Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Acquiring lock "cinder-60c0fc0a-3215-457b-ad3b-92697181b0c9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "cinder-60c0fc0a-3215-457b-ad3b-92697181b0c9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Acquiring lock "cinder-quobyte-60c0fc0a-3215-457b-ad3b-92697181b0c9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "cinder-quobyte-60c0fc0a-3215-457b-ad3b-92697181b0c9" acquired by "delete_volume" :: waited 0.036s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:10:33 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:33 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Spawned new privsep daemon via rootwrap Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Accepted privsep connection to /tmp/tmpjzwhwhts/privsep.sock {{(pid=84171) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 28 16:10:33 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 28 16:10:33 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 28 16:10:33 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 28 16:10:33 devstack cinder-volume[84171]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85354 Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a109747-3360-44e5-9e82-bb8c70f9bb63]: (2,) {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:10:33 devstack cinder-volume[84171]: WARNING oslo_privsep.priv_context [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] privsep daemon already running Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[681c44f3-782e-439d-b9bf-c9be49f0f8e5]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3abb0f6-98d6-4c19-adbb-e1c4642110cd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:34 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a Apr 28 16:10:34 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:34 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 Apr 28 16:10:34 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:35 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9" returned: 0 in 1.889s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:35 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9 Apr 28 16:10:35 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Flow 'volume_create_manager' (af909791-b6ce-43a2-9c69-daf93be34db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee048dab-8565-4932-a269-8eab7c20628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee048dab-8565-4932-a269-8eab7c20628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2135413074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8af8bd-719c-4ad3-81b3-a0ade0d326e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4964400433fd4a039c2f95528d40d364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:36Z,use_quota=True,user_id='6675ff5d7eb84472b989eaef086af98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f09bae-84db-4bf4-a613-ee3afb27a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f09bae-84db-4bf4-a613-ee3afb27a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc0356f-327e-4781-809b-a5087b9e3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc0356f-327e-4781-809b-a5087b9e3fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8af8bd-719c-4ad3-81b3-a0ade0d326e3', 'volume_name': 'volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eea91ae-647b-49a1-94d3-04e0e80f5799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eea91ae-647b-49a1-94d3-04e0e80f5799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cb9ff8-69f5-41c2-bc4a-a27794585329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Volume fa8af8bd-719c-4ad3-81b3-a0ade0d326e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3', 'volume_size': 1} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2135413074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8af8bd-719c-4ad3-81b3-a0ade0d326e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4964400433fd4a039c2f95528d40d364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:36Z,use_quota=True,user_id='6675ff5d7eb84472b989eaef086af98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Creating volume fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:10:36 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:36 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:36 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 1073741824 Apr 28 16:10:36 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" returned: 0 in 2.381s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:36 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a Apr 28 16:10:36 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:37 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-60c0fc0a-3215-457b-ad3b-92697181b0c9" returned: 0 in 1.498s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "cinder-quobyte-60c0fc0a-3215-457b-ad3b-92697181b0c9" released by "delete_volume" :: held 3.637s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:10:37 devstack cinder-volume[84171]: WARNING cinder.quota [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:10:37 devstack cinder-volume[84171]: WARNING cinder.quota [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG cinder.quota [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Created reservations ['c5258532-8249-4a8f-a52d-b360b66077f8', '1c824b16-cde4-4e9d-837b-c1060c82921f', '86799403-9268-4ee9-8596-9472381391a6', '716c8edc-9fa0-4a96-821b-7159c2a60c25'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:37 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:37 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:10:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" returned: 0 in 1.683s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:37 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "cinder-quobyte-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a" released by "delete_volume" :: held 7.310s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:10:38 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 1073741824" returned: 0 in 1.787s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Created reservations ['feed6e9c-f929-4973-95b5-1dc42e20aae4', '9cb2e9b8-0f05-4acd-9b0f-0d72dd1d5d3e', '79cb3810-4527-48b4-8a8a-fa2866afebec', '734d7f0b-97fc-491c-bc0a-a556f528156b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:38 devstack sudo[85393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 Apr 28 16:10:38 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:38 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:10:38 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Flow 'volume_create_manager' (dbd5d4ca-30fa-4671-b609-a8e01d89954f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff00f89-19c9-4d9f-b630-0c7b799273f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff00f89-19c9-4d9f-b630-0c7b799273f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-866008691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb17cc7-880e-458c-b6cd-fee6e2d93e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098e41e57fc74caba092c087e0139937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:39Z,use_quota=True,user_id='a3ae8bb24ff643fdbd8a5a3e92a8f9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3615ff3-8c27-4110-9664-92f43a5c0aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3615ff3-8c27-4110-9664-92f43a5c0aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383ee51-7d4a-4bd2-bebb-9b655899a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383ee51-7d4a-4bd2-bebb-9b655899a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb17cc7-880e-458c-b6cd-fee6e2d93e51', 'volume_name': 'volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ca92b-8498-440f-91c3-2c33badcb4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1ca92b-8498-440f-91c3-2c33badcb4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9afc17-c5aa-4413-adc9-366794f6d9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Volume aeb17cc7-880e-458c-b6cd-fee6e2d93e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51', 'volume_size': 1} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:39 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" returned: 0 in 1.666s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] <== create_volume: return (3610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.614s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-866008691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb17cc7-880e-458c-b6cd-fee6e2d93e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='098e41e57fc74caba092c087e0139937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:39Z,use_quota=True,user_id='a3ae8bb24ff643fdbd8a5a3e92a8f9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Creating volume aeb17cc7-880e-458c-b6cd-fee6e2d93e51 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:10:39 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:10:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:40 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 1073741824 Apr 28 16:10:40 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69cb9ff8-69f5-41c2-bc4a-a27794585329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac6b643-1d1e-41e8-94de-bb248dc60643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Volume volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 (fa8af8bd-719c-4ad3-81b3-a0ade0d326e3): created successfully Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac6b643-1d1e-41e8-94de-bb248dc60643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Flow 'volume_create_manager' (af909791-b6ce-43a2-9c69-daf93be34db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:40 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 2.284s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.manager [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:10:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-08b77db6-fb41-4204-b983-660f87f6236d tempest-ServerRescueNegativeTestJSON-922798328 None] Created volume successfully. Apr 28 16:10:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Deleted volume successfully. Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-290a2625-5160-492b-a975-50537a1eebc2 req-2ffaca2f-1033-4e77-8706-cd7d75eb51df tempest-VolumesGetTestJSON-1431760446 None] Lock "cinder-60c0fc0a-3215-457b-ad3b-92697181b0c9-delete_volume" released by "delete_volume" :: held 6.711s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:10:40 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.961s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:10:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Deleted volume successfully. Apr 28 16:10:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-43080b00-9a86-451f-a063-af697471a760 tempest-VolumesAdminNegativeTest-1215073220 None] Lock "cinder-68d81fd0-c1a6-4ef7-b58e-100c2c7b9d3a-delete_volume" released by "delete_volume" :: held 9.904s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:10:42 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 1073741824" returned: 0 in 2.067s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:42 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 Apr 28 16:10:42 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:43 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" returned: 0 in 1.671s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] <== create_volume: return (3883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.893s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9afc17-c5aa-4413-adc9-366794f6d9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254a0b8c-1756-44ed-88e5-ce385b5edd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:43 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Volume volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 (aeb17cc7-880e-458c-b6cd-fee6e2d93e51): created successfully Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254a0b8c-1756-44ed-88e5-ce385b5edd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Flow 'volume_create_manager' (dbd5d4ca-30fa-4671-b609-a8e01d89954f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-40301f7b-39f4-4db9-bc83-dd9b96fb1774 tempest-DeleteServersTestJSON-518163414 None] Created volume successfully. Apr 28 16:10:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ab207226-6e8c-4124-a9ea-45f8a5b4ce4f tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-676259724: creating Apr 28 16:10:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ab207226-6e8c-4124-a9ea-45f8a5b4ce4f tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-676259724: created successfully Apr 28 16:10:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ab207226-6e8c-4124-a9ea-45f8a5b4ce4f tempest-GroupSnapshotsTest-1217726435 None] Create group completed successfully. Apr 28 16:10:51 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:10:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (55f979b5-cb7d-419f-b3da-145b6165f6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af60faf-dc77-46ed-8063-3e799c748474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af60faf-dc77-46ed-8063-3e799c748474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1756364940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d303da66-5bce-44fe-80b2-cff30def6336,host='devstack@QuobyteHD#QuobyteHD',id=b0602d2e-b866-4925-aa44-492c21816221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:52Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef2d732-790f-4317-9e95-c56f46271f2e),volume_type_id=5ef2d732-790f-4317-9e95-c56f46271f2e)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c993c3c-52f2-4bf1-863b-503ca38df9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c993c3c-52f2-4bf1-863b-503ca38df9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a928477d-6edd-4e1f-9bf1-74aa0eb5821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a928477d-6edd-4e1f-9bf1-74aa0eb5821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0602d2e-b866-4925-aa44-492c21816221', 'volume_name': 'volume-b0602d2e-b866-4925-aa44-492c21816221', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b70ba70-178c-4fcb-b8bd-8a16ec90a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b70ba70-178c-4fcb-b8bd-8a16ec90a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f9e1ea-c2db-4972-bbbd-d69a2bfb3457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:52 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Volume b0602d2e-b866-4925-aa44-492c21816221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0602d2e-b866-4925-aa44-492c21816221', 'volume_size': 1} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d303da66-5bce-44fe-80b2-cff30def6336,created_at=2026-04-28T14:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1756364940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d303da66-5bce-44fe-80b2-cff30def6336,host='devstack@QuobyteHD#QuobyteHD',id=b0602d2e-b866-4925-aa44-492c21816221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:10:52Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ef2d732-790f-4317-9e95-c56f46271f2e),volume_type_id=5ef2d732-790f-4317-9e95-c56f46271f2e)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Creating volume b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:10:52 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:52 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 1073741824 Apr 28 16:10:52 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:52 devstack cinder-volume[84171]: WARNING py.warnings [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 28 16:10:52 devstack cinder-volume[84171]: .first() Apr 28 16:10:52 devstack cinder-volume[84171]: Apr 28 16:10:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:53 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 1073741824" returned: 0 in 1.268s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:53 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:10:53 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:54 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 0.812s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.530s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f9e1ea-c2db-4972-bbbd-d69a2bfb3457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0602d2e-b866-4925-aa44-492c21816221', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcdf915-02c8-4428-93be-66906aa99262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fdda3e-6ea9-4d8c-a153-3fb2c59c5dfa]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:54 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Volume volume-b0602d2e-b866-4925-aa44-492c21816221 (b0602d2e-b866-4925-aa44-492c21816221): created successfully Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcdf915-02c8-4428-93be-66906aa99262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:10:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (55f979b5-cb7d-419f-b3da-145b6165f6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:10:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-08d71a54-b4ad-4076-b705-6bd3d86885c4 tempest-GroupSnapshotsTest-1217726435 None] Created volume successfully. Apr 28 16:10:54 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 Apr 28 16:10:54 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:55 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" returned: 0 in 0.953s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.997s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207', 'name': 'volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e385a23-b1f0-42a2-8b10-0f78f2b7a75c', 'enforce_multipath': True} {{(pid=84171) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 16:10:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-6fe78543-84ed-4240-b940-01eb27003dd3 req-93cdc6ab-9148-4c01-9840-4370dfaa247c tempest-DeleteServersTestJSON-518163414 None] attachment_update completed successfully. Apr 28 16:10:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] GroupSnapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: creating. Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Group snapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: creating. {{(pid=84171) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:10:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Creating offline snapshot 6d7134f4-8f97-4a98-82c2-4ecab03430ac of volume b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:10:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[761883d9-ce11-4bd1-881e-6256ab1cff4c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:10:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:56 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:10:56 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:57 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 1.003s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:57 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac 1G Apr 28 16:10:57 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:58 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac 1G" returned: 0 in 1.133s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0602d2e-b866-4925-aa44-492c21816221 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:58 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0602d2e-b866-4925-aa44-492c21816221 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:10:58 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:10:59 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 28 16:10:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0602d2e-b866-4925-aa44-492c21816221 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 1.098s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:10:59 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:10:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:10:59 devstack sudo[86127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:10:59 devstack sudo[86127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:00 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:00 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:01 devstack sudo[86127]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 1.751s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:01 devstack sudo[86132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info Apr 28 16:11:01 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:02 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 2.164s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:02 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:02 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info" returned: 0 in 1.847s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:02 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:02 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info Apr 28 16:11:02 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:04 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.info" returned: 0 in 1.345s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.383s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:04 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cb7def76-be16-4db2-a927-d7e8dd2bc354 tempest-GroupSnapshotsTest-1217726435 None] group_snapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: created successfully Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Acquiring lock "cinder-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "cinder-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Acquiring lock "cinder-quobyte-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "cinder-quobyte-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5db5c0-210b-4ac5-a8c8-4321f2f609be]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:06 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 Apr 28 16:11:06 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-68c17147-49b1-40f1-90fb-07811d30496c req-564b60e9-96fe-4775-be87-cefd9c61c102 tempest-DeleteServersTestJSON-518163414 None] Terminate volume connection completed successfully. Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-68c17147-49b1-40f1-90fb-07811d30496c req-564b60e9-96fe-4775-be87-cefd9c61c102 tempest-DeleteServersTestJSON-518163414 None] Deleting attachment 4e385a23-b1f0-42a2-8b10-0f78f2b7a75c. {{(pid=84171) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac-c8597e76-2e40-472a-b10e-645f35c59469" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac-c8597e76-2e40-472a-b10e-645f35c59469" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Creating volume c8597e76-2e40-472a-b10e-645f35c59469 from snapshot 6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] snapshot: 6d7134f4-8f97-4a98-82c2-4ecab03430ac, volume: c8597e76-2e40-472a-b10e-645f35c59469, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be2d9c6-af53-4085-b172-0bd6e6e6de66]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:07 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:11:07 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:07 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" returned: 0 in 1.424s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:08 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3 Apr 28 16:11:08 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:08 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 1.127s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0602d2e-b866-4925-aa44-492c21816221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87d62ad-19a5-4e74-a1ff-726ec995ca49]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:08 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:11:08 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:08 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" returned: 0 in 0.952s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "cinder-quobyte-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3" released by "delete_volume" :: held 2.425s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Created reservations ['945e3ec9-e8d9-4ed4-be93-d2d5d9176e02', '8050c713-6643-48d0-aabf-2cb32c9e0be6', 'c1e89bff-8b45-4624-bb21-c0e26d495c7d', '31f5566e-fea6-45b3-8498-2e9736eabb8c'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:09 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:09 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:09 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 1.228s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:11:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:09 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 Apr 28 16:11:09 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:10 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.151s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:10 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:10 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Deleted volume successfully. Apr 28 16:11:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4f473423-8a06-477f-bd5d-6d1abca1932b tempest-ServerRescueNegativeTestJSON-922798328 None] Lock "cinder-fa8af8bd-719c-4ad3-81b3-a0ade0d326e3-delete_volume" released by "delete_volume" :: held 3.928s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "cinder-aeb17cc7-880e-458c-b6cd-fee6e2d93e51-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "cinder-aeb17cc7-880e-458c-b6cd-fee6e2d93e51-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "cinder-quobyte-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "cinder-quobyte-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" acquired by "delete_volume" :: waited 0.068s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1019c-5071-4eba-aef0-0b60c43b8970]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:13 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 Apr 28 16:11:13 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:15 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" returned: 0 in 2.199s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:15 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51 Apr 28 16:11:15 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:17 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" returned: 0 in 2.486s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "cinder-quobyte-aeb17cc7-880e-458c-b6cd-fee6e2d93e51" released by "delete_volume" :: held 4.852s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Created reservations ['47e0c2e6-be9d-4c54-8d5c-17911a37ab87', '55b347c4-1a28-4477-b8e3-b0a227a6d2f6', '2336b041-c3ae-4190-994e-e865acb4852e', 'b862c5a8-ce70-4dd2-b3d7-ffb60ea79edc'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:17 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:17 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:18 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469" returned: 0 in 9.457s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:19 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc521f1-c01b-492c-8a47-eef8c6ac4b12]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:19 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:11:19 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:19 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.256s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:19 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:19 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Deleted volume successfully. Apr 28 16:11:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a937da75-aee1-4c9c-8cfe-30bd2399c683 tempest-DeleteServersTestJSON-518163414 None] Lock "cinder-aeb17cc7-880e-458c-b6cd-fee6e2d93e51-delete_volume" released by "delete_volume" :: held 6.524s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:20 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 0.999s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:11:20 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Converted 1024.00 MB image at 108.26 MB/s Apr 28 16:11:20 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:20 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 Apr 28 16:11:20 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:20 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469" returned: 0 in 0.687s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" released by "_copy_volume_from_snapshot" :: held 13.719s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac-c8597e76-2e40-472a-b10e-645f35c59469" released by "_create_volume_from_snapshot" :: held 13.775s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.804s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:20 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9dde4a1e-b81b-4bda-a8fc-cfe5b73105b3 tempest-GroupSnapshotsTest-1217726435 None] Create group from source-snapshot-a8fa74d2-a583-4151-a123-d46053fdcdd5 completed successfully. Apr 28 16:11:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acbbbec-5634-4de6-b255-fcad17dcfe0e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:21 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 Apr 28 16:11:21 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:22 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469" returned: 0 in 0.925s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:22 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469 Apr 28 16:11:22 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:23 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c8597e76-2e40-472a-b10e-645f35c59469" returned: 0 in 1.007s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-c8597e76-2e40-472a-b10e-645f35c59469" released by "delete_volume" :: held 1.995s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['6e1499fe-1f16-4bd8-95ea-eb611a0d0a36'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:23 devstack cinder-volume[84171]: WARNING cinder.quota [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1666184484 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1666184484, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:11:23 devstack cinder-volume[84171]: WARNING cinder.quota [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1666184484 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1666184484, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['ed1acebf-590c-48df-8c9d-48f4ae297d2e', 'ac5eed1a-2abf-428b-9ef0-d38e38fb467c', '88fcf0f2-ba97-45d1-82ed-0c262627d0e0', '4a86cdab-f8ca-4266-8343-0497f48058aa'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:23 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:23 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:24 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.787s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-bff22011-a2ec-4ee3-895c-fd1b143330ab tempest-GroupSnapshotsTest-1217726435 None] Delete group completed successfully. Apr 28 16:11:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] group_snapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: deleting Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=69,cinder:UPDATE=56,cinder:INSERT=13,cinder:DELETE=4 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=49,cinder:UPDATE=73,cinder:INSERT=14,cinder:DELETE=5 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] group_snapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: deleting {{(pid=84171) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Deleting offline snapshot 6d7134f4-8f97-4a98-82c2-4ecab03430ac of volume b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] snapshot_file for this snap is: volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46e13c-1065-4482-9aec-e48b8f19af28]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:25 devstack sudo[86599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:11:25 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:25 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 0.761s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0602d2e-b866-4925-aa44-492c21816221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:11:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2699a118-3c52-47bc-a405-9a74ca3bf134]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:26 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:11:26 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:26 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 0.832s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:26 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:11:26 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Flow 'volume_create_manager' (1793e84d-00d8-4a56-bd56-3bbe51868b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15ffba6-47c6-4775-bfb3-7b592cdd88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15ffba6-47c6-4775-bfb3-7b592cdd88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-814474381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7023e9-4313-48ec-b019-0b8aeab08408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7aade641a4ae2a2ffa1a010404a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:27Z,use_quota=True,user_id='782d29c91a9c45c5a9ddb06e3a764a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6efdba-5629-41cc-8529-c74d19217077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6efdba-5629-41cc-8529-c74d19217077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f893b8-e480-488b-bfa0-86421d337270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f893b8-e480-488b-bfa0-86421d337270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7023e9-4313-48ec-b019-0b8aeab08408', 'volume_name': 'volume-4a7023e9-4313-48ec-b019-0b8aeab08408', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2f1473-7805-42f8-9589-858662c14fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2f1473-7805-42f8-9589-858662c14fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ba7d79-4a40-4818-b554-447ea6d387e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Volume 4a7023e9-4313-48ec-b019-0b8aeab08408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7023e9-4313-48ec-b019-0b8aeab08408', 'volume_size': 1} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-814474381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a7023e9-4313-48ec-b019-0b8aeab08408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d7aade641a4ae2a2ffa1a010404a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:27Z,use_quota=True,user_id='782d29c91a9c45c5a9ddb06e3a764a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Creating volume 4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:11:27 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:27 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 1073741824 Apr 28 16:11:27 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:27 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 0.895s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:27 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac Apr 28 16:11:27 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:28 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221.6d7134f4-8f97-4a98-82c2-4ecab03430ac" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-6d7134f4-8f97-4a98-82c2-4ecab03430ac" released by "_delete_snapshot" :: held 3.362s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" released by "delete_snapshot" :: held 3.390s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:28 devstack cinder-volume[84171]: WARNING cinder.quota [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1666184484 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1666184484, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['9a82c7e0-689f-4e7c-9811-b0d59549c5f6', '378dbee7-4f8f-40a6-aca2-6cd1e64020c3', '6605affe-3fcd-47a2-be50-db19668ffd5f', '66a302e8-f44c-4b89-8bf0-d26847e50a81'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:28 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 1073741824" returned: 0 in 1.123s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:28 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f9071310-863f-44a9-9a86-f4e27df812e0 tempest-GroupSnapshotsTest-1217726435 None] group_snapshot a8fa74d2-a583-4151-a123-d46053fdcdd5: deleted successfully Apr 28 16:11:28 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 Apr 28 16:11:28 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:29 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408" returned: 0 in 0.636s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ba7d79-4a40-4818-b554-447ea6d387e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7023e9-4313-48ec-b019-0b8aeab08408', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c76911-6788-47d8-bdc6-ab346abf595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:29 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Volume volume-4a7023e9-4313-48ec-b019-0b8aeab08408 (4a7023e9-4313-48ec-b019-0b8aeab08408): created successfully Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c76911-6788-47d8-bdc6-ab346abf595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Flow 'volume_create_manager' (1793e84d-00d8-4a56-bd56-3bbe51868b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-a6a70c91-2f93-4647-8450-2d3ddda000aa req-04545027-e2fe-4a95-8440-64a413480458 tempest-VolumesSnapshotsTestJSON-838491531 None] Created volume successfully. Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" acquired by "delete_volume" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc88dd-892e-4929-b981-70d3ef3efa41]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Creating offline snapshot d84f8bf7-77df-43e7-95ee-3d653392c713 of volume 4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55ae5f-8ed2-4634-935b-755ca969335a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:30 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:11:30 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:30 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 Apr 28 16:11:30 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:31 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 1.005s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:31 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221 Apr 28 16:11:31 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:31 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408" returned: 0 in 1.037s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:31 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 1G Apr 28 16:11:31 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:31 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b0602d2e-b866-4925-aa44-492c21816221" returned: 0 in 0.840s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-b0602d2e-b866-4925-aa44-492c21816221" released by "delete_volume" :: held 1.961s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:31 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['b32f8cfb-337c-46c5-aa34-b75e32ef7ab2'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:32 devstack cinder-volume[84171]: WARNING cinder.db.sqlalchemy.api [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1666184484'] Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['a1759454-99ab-4486-9e94-27c521b0d951', '52574ead-b02f-40cd-8f3d-8c58f6f20c3b', '1cc1e2b6-7557-4e51-8212-7d4a05132da4', 'a9e36a0d-efc2-4c1f-ab32-17d5e04615e1'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:32 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:32 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:32 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 1G" returned: 0 in 1.084s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7023e9-4313-48ec-b019-0b8aeab08408 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:32 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7023e9-4313-48ec-b019-0b8aeab08408 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 Apr 28 16:11:32 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:33 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e16c9555-cbdf-4b46-9128-e58644c20ec9 tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-1150435383: creating Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.898s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0590a02f-efca-4bc5-8e79-23bbf8d1bd06 tempest-GroupSnapshotsTest-1217726435 None] Delete group completed successfully. Apr 28 16:11:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e16c9555-cbdf-4b46-9128-e58644c20ec9 tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-1150435383: created successfully Apr 28 16:11:33 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a7023e9-4313-48ec-b019-0b8aeab08408 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713" returned: 0 in 0.897s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 is being set with open permissions: ugo+rw Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e16c9555-cbdf-4b46-9128-e58644c20ec9 tempest-GroupSnapshotsTest-1217726435 None] Create group completed successfully. Apr 28 16:11:33 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 Apr 28 16:11:33 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:33 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:33 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info Apr 28 16:11:33 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:34 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info" returned: 0 in 0.881s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:34 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info is being set with open permissions: ugo+rw Apr 28 16:11:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:34 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info Apr 28 16:11:34 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (6d39b294-1dd7-42c3-910a-a05a534aaee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e549438-6e0c-4ea1-99bf-99ce1cd1fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e549438-6e0c-4ea1-99bf-99ce1cd1fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1649648520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,host='devstack@QuobyteHD#QuobyteHD',id=dee4ca3a-da8b-4f31-9a25-0943b63a3b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:35Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e358f2f-c5e5-43e6-b0d8-f46b00504eb2),volume_type_id=7e358f2f-c5e5-43e6-b0d8-f46b00504eb2)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7971ec85-4c47-4a3f-83d7-28d25055f591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7971ec85-4c47-4a3f-83d7-28d25055f591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d12fa2-50f8-4b47-838c-13a652a7eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d12fa2-50f8-4b47-838c-13a652a7eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee4ca3a-da8b-4f31-9a25-0943b63a3b8a', 'volume_name': 'volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14013e50-f141-4123-b1dd-243ceedbd18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14013e50-f141-4123-b1dd-243ceedbd18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae587248-9584-4a7d-9e36-857161f4f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Volume dee4ca3a-da8b-4f31-9a25-0943b63a3b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a', 'volume_size': 1} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:35 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.info" returned: 0 in 0.756s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.551s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,created_at=2026-04-28T14:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1649648520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,host='devstack@QuobyteHD#QuobyteHD',id=dee4ca3a-da8b-4f31-9a25-0943b63a3b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:35Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e358f2f-c5e5-43e6-b0d8-f46b00504eb2),volume_type_id=7e358f2f-c5e5-43e6-b0d8-f46b00504eb2)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Creating volume dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:11:35 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:11:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:35 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a 1073741824 Apr 28 16:11:35 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-2209f881-73e2-4b4e-8e4d-5f59cdf5d9bb req-823ca5d6-1578-4b5a-a561-f4b442a63893 tempest-VolumesSnapshotsTestJSON-838491531 None] Create snapshot completed successfully Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "cinder-d84f8bf7-77df-43e7-95ee-3d653392c713-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-d84f8bf7-77df-43e7-95ee-3d653392c713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "cinder-quobyte-d84f8bf7-77df-43e7-95ee-3d653392c713" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-d84f8bf7-77df-43e7-95ee-3d653392c713" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Deleting offline snapshot d84f8bf7-77df-43e7-95ee-3d653392c713 of volume 4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] snapshot_file for this snap is: volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90bc91-f78d-46a8-b4fb-e1f3124674c6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:36 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 Apr 28 16:11:36 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:36 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a 1073741824" returned: 0 in 1.008s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:36 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a Apr 28 16:11:36 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:37 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713" returned: 0 in 0.879s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a7023e9-4313-48ec-b019-0b8aeab08408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b79809-c22e-4f76-9522-07d37c744668]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:37 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 Apr 28 16:11:37 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:37 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" returned: 0 in 0.766s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae587248-9584-4a7d-9e36-857161f4f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236b4ba0-e075-4c18-aaa2-776cf7423d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Volume volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a (dee4ca3a-da8b-4f31-9a25-0943b63a3b8a): created successfully Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236b4ba0-e075-4c18-aaa2-776cf7423d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (6d39b294-1dd7-42c3-910a-a05a534aaee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ff416c7e-cf30-4729-909e-8cf96faa966c tempest-GroupSnapshotsTest-1217726435 None] Created volume successfully. Apr 28 16:11:38 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408" returned: 0 in 0.930s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:38 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 Apr 28 16:11:38 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:38 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713" returned: 0 in 0.771s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:38 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713 Apr 28 16:11:38 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (039a382b-988d-4952-80ab-7c619d653d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4021fe7-2c93-4fac-964b-eef43ff67f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4021fe7-2c93-4fac-964b-eef43ff67f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946422420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,host='devstack@QuobyteHD#QuobyteHD',id=98109163-9a2c-47f8-a964-10fd969cd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:39Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e358f2f-c5e5-43e6-b0d8-f46b00504eb2),volume_type_id=7e358f2f-c5e5-43e6-b0d8-f46b00504eb2)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b314abf9-c322-43a8-88a8-eaa35ae38d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b314abf9-c322-43a8-88a8-eaa35ae38d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8be0087-41ef-43e6-932c-c70fdb98f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8be0087-41ef-43e6-932c-c70fdb98f425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98109163-9a2c-47f8-a964-10fd969cd40c', 'volume_name': 'volume-98109163-9a2c-47f8-a964-10fd969cd40c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaac7dcf-e230-4a64-8337-3a9054692e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaac7dcf-e230-4a64-8337-3a9054692e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5349a1c-f3f6-4585-b59d-e9e33b019597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Volume 98109163-9a2c-47f8-a964-10fd969cd40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98109163-9a2c-47f8-a964-10fd969cd40c', 'volume_size': 1} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,created_at=2026-04-28T14:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946422420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdc6020-31ca-4d6d-85fb-28fe62aa802c,host='devstack@QuobyteHD#QuobyteHD',id=98109163-9a2c-47f8-a964-10fd969cd40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:39Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e358f2f-c5e5-43e6-b0d8-f46b00504eb2),volume_type_id=7e358f2f-c5e5-43e6-b0d8-f46b00504eb2)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Creating volume 98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:11:39 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:39 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c 1073741824 Apr 28 16:11:39 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:39 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408.d84f8bf7-77df-43e7-95ee-3d653392c713" returned: 0 in 0.817s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-d84f8bf7-77df-43e7-95ee-3d653392c713" released by "_delete_snapshot" :: held 3.567s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" released by "delete_snapshot" :: held 3.602s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:39 devstack cinder-volume[84171]: WARNING cinder.quota [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.quota [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Created reservations ['fd20de64-2b64-468c-af78-9e9f9e40c41b', '3e21a7a4-ae8f-4220-bca3-c83f38f6786f', 'f94a7331-285c-4f35-8a84-40a450b99b23', '334394b2-2b43-46a5-9dd0-a36fc6105c4a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Delete snapshot completed successfully. Apr 28 16:11:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-ccacaeec-2b6f-4e50-a1af-480673d1d7ba req-6afb1efc-4038-4047-a49e-854594d16205 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-d84f8bf7-77df-43e7-95ee-3d653392c713-delete_snapshot" released by "delete_snapshot" :: held 3.795s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:40 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c 1073741824" returned: 0 in 0.956s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:40 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c Apr 28 16:11:40 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "cinder-4a7023e9-4313-48ec-b019-0b8aeab08408-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-4a7023e9-4313-48ec-b019-0b8aeab08408-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b1cac-1b83-4e16-a4d0-3938b72cc7a6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:40 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c" returned: 0 in 0.709s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:40 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5349a1c-f3f6-4585-b59d-e9e33b019597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98109163-9a2c-47f8-a964-10fd969cd40c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:40 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79890559-97b9-4a9e-a21c-a06f62fde3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Volume volume-98109163-9a2c-47f8-a964-10fd969cd40c (98109163-9a2c-47f8-a964-10fd969cd40c): created successfully Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79890559-97b9-4a9e-a21c-a06f62fde3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (039a382b-988d-4952-80ab-7c619d653d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8986a279-f269-4ac9-a2e9-f01fe427f0b8 tempest-GroupSnapshotsTest-1217726435 None] Created volume successfully. Apr 28 16:11:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d6390bc6-c497-4c54-8cbc-eebedbb6c81b tempest-GroupSnapshotsTest-1217726435 None] Update group completed successfully. Apr 28 16:11:41 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408" returned: 0 in 0.879s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:41 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408 Apr 28 16:11:41 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:42 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4a7023e9-4313-48ec-b019-0b8aeab08408" returned: 0 in 0.691s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-quobyte-4a7023e9-4313-48ec-b019-0b8aeab08408" released by "delete_volume" :: held 1.657s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG cinder.quota [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Created reservations ['03bc9e5e-0c26-4974-b597-99de03998e93', '96b4c8d1-6d76-478e-999f-e0ea914962e4', '61600e10-41ea-41c0-8b70-6fcd89e21e00', 'abfe02cf-10a2-429b-86b8-c1990c288a2b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:42 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:11:42 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-be7d88b8-a5a5-4d5b-8bc2-a54b944eee03 tempest-GroupSnapshotsTest-1217726435 None] Update group completed successfully. Apr 28 16:11:43 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.804s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:43 devstack cinder-volume[84171]: DEBUG cinder.manager [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:11:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Deleted volume successfully. Apr 28 16:11:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-a99791d8-f064-429c-ae13-115541b861f5 req-61e4a67f-115d-4a22-9b08-808ee5243f56 tempest-VolumesSnapshotsTestJSON-838491531 None] Lock "cinder-4a7023e9-4313-48ec-b019-0b8aeab08408-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:11:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d7070248-be8e-4745-a168-d52787c57c3f tempest-GroupSnapshotsTest-1217726435 None] Update group completed successfully. Apr 28 16:11:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cfba358e-3495-4d86-aa17-fa9deea54e01 tempest-GroupSnapshotsTest-1217726435 None] Update group completed successfully. Apr 28 16:11:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] GroupSnapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: creating. Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Group snapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: creating. {{(pid=84171) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Creating offline snapshot 0667d0c5-06b5-4997-8010-0b9d5fa60df2 of volume 98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5ef14-2757-4f23-a11f-a0a66eed46c0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:47 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c Apr 28 16:11:47 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:48 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c" returned: 0 in 1.111s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:48 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 1G Apr 28 16:11:48 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:49 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 1G" returned: 0 in 1.070s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98109163-9a2c-47f8-a964-10fd969cd40c -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:49 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98109163-9a2c-47f8-a964-10fd969cd40c -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 Apr 28 16:11:49 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (595ec24d-8648-4d67-a826-49e27b0b4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42173dd0-ed8c-4b49-b3f6-8d1220959330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42173dd0-ed8c-4b49-b3f6-8d1220959330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-389485147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bda7554-8cbb-447a-8079-cd05dc2b17a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:49Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f87e18f-ed38-4c41-b995-1e660858b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f87e18f-ed38-4c41-b995-1e660858b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916182f-7cab-4ee4-9d3d-699fd77b4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1916182f-7cab-4ee4-9d3d-699fd77b4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bda7554-8cbb-447a-8079-cd05dc2b17a8', 'volume_name': 'volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d2b43-4b34-4904-91d5-9873aab1c340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528d2b43-4b34-4904-91d5-9873aab1c340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26aa3c-6d76-4f44-9276-77d98baf679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:49 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Volume 7bda7554-8cbb-447a-8079-cd05dc2b17a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8', 'volume_size': 1} Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:49 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98109163-9a2c-47f8-a964-10fd969cd40c -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2" returned: 0 in 0.633s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:49 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:49 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 Apr 28 16:11:49 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:50 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2" returned: 0 in 0.644s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:50 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info Apr 28 16:11:50 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:51 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info" returned: 0 in 0.629s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:51 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:51 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info Apr 28 16:11:51 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:51 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.info" returned: 0 in 0.659s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Creating offline snapshot 08edccc1-de76-4020-a844-5e93503aa8a8 of volume dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[04714ce8-f14d-41ac-b4fb-00b9b5529e8d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:51 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a Apr 28 16:11:51 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:52 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" returned: 0 in 0.719s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:52 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 1G Apr 28 16:11:52 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:53 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 1G" returned: 0 in 1.283s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:53 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 Apr 28 16:11:53 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:54 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8" returned: 0 in 0.972s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:54 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:54 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 Apr 28 16:11:54 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:55 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8" returned: 0 in 0.767s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:55 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info Apr 28 16:11:55 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:56 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info" returned: 0 in 0.854s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:56 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:11:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:56 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info Apr 28 16:11:56 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:57 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.info" returned: 0 in 0.659s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.369s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.785s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-389485147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bda7554-8cbb-447a-8079-cd05dc2b17a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:11:49Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Creating volume 7bda7554-8cbb-447a-8079-cd05dc2b17a8 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:11:57 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:57 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 1073741824 Apr 28 16:11:57 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-04e64771-9e61-4a2b-8b8d-16a1535a6e1d tempest-GroupSnapshotsTest-1217726435 None] group_snapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: created successfully Apr 28 16:11:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] group_snapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: deleting Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] group_snapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: deleting {{(pid=84171) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-0667d0c5-06b5-4997-8010-0b9d5fa60df2" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-0667d0c5-06b5-4997-8010-0b9d5fa60df2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Deleting offline snapshot 0667d0c5-06b5-4997-8010-0b9d5fa60df2 of volume 98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] snapshot_file for this snap is: volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a7f8a9-b075-404f-80cf-7244baf0be0a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:57 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 Apr 28 16:11:57 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:58 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 1073741824" returned: 0 in 1.075s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:58 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 Apr 28 16:11:58 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:58 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2" returned: 0 in 0.925s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98109163-9a2c-47f8-a964-10fd969cd40c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db9fee7-d007-4b6e-9940-a751c6d6f6fa]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:11:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:58 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c Apr 28 16:11:58 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:11:59 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8" returned: 0 in 0.816s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df26aa3c-6d76-4f44-9276-77d98baf679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5466fca1-257b-4ee4-8b17-1215e9d3f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:11:59 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Volume volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 (7bda7554-8cbb-447a-8079-cd05dc2b17a8): created successfully Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5466fca1-257b-4ee4-8b17-1215e9d3f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (595ec24d-8648-4d67-a826-49e27b0b4c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:11:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-08260f44-0f3c-46b9-8f3d-725fc78678b1 tempest-VolumesTestJSON-1658208865 None] Created volume successfully. Apr 28 16:11:59 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c" returned: 0 in 0.838s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:11:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:11:59 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 Apr 28 16:11:59 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:00 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2" returned: 0 in 0.763s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:00 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2 Apr 28 16:12:00 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:00 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:00 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (027ffe57-055f-43db-843a-6a7d782bd7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f421f8ad-58f9-4ba2-bc48-5c59e4314cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f421f8ad-58f9-4ba2-bc48-5c59e4314cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783004181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93253b8-9d9f-4c4b-bde1-8e9dd4384d03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:01Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b23e603-52bd-4fe3-a50c-d8cb5cd82c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b23e603-52bd-4fe3-a50c-d8cb5cd82c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e7089-08c0-41fc-8fde-ec2a3c644845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1e7089-08c0-41fc-8fde-ec2a3c644845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93253b8-9d9f-4c4b-bde1-8e9dd4384d03', 'volume_name': 'volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd196643-3d92-47f4-8b1f-8cb55c9494c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd196643-3d92-47f4-8b1f-8cb55c9494c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e7614d-4003-4577-a274-8468696743ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:00 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Volume e93253b8-9d9f-4c4b-bde1-8e9dd4384d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03', 'volume_size': 1} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783004181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93253b8-9d9f-4c4b-bde1-8e9dd4384d03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:01Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Creating volume e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:00 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:00 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 1073741824 Apr 28 16:12:00 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:01 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c.0667d0c5-06b5-4997-8010-0b9d5fa60df2" returned: 0 in 1.156s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-0667d0c5-06b5-4997-8010-0b9d5fa60df2" released by "_delete_snapshot" :: held 3.850s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" released by "delete_snapshot" :: held 3.888s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" acquired by "delete_snapshot" :: waited 0.062s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-08edccc1-de76-4020-a844-5e93503aa8a8" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-08edccc1-de76-4020-a844-5e93503aa8a8" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Deleting offline snapshot 08edccc1-de76-4020-a844-5e93503aa8a8 of volume dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] snapshot_file for this snap is: volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6ede2d-c63a-4fc5-b365-0da7cbaf09bf]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:02 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:02 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 Apr 28 16:12:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.461s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:02 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:02 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:02 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 1073741824" returned: 0 in 2.040s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:03 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 Apr 28 16:12:03 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:03 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8" returned: 0 in 1.623s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:12:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a858c4a-bc80-4776-b082-11a920d416cd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:03 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a Apr 28 16:12:03 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:04 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" returned: 0 in 1.616s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] <== create_volume: return (3739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.751s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e7614d-4003-4577-a274-8468696743ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a06957-ec4f-4f92-a581-1082c13f92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:04 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Volume volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 (e93253b8-9d9f-4c4b-bde1-8e9dd4384d03): created successfully Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a06957-ec4f-4f92-a581-1082c13f92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (027ffe57-055f-43db-843a-6a7d782bd7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:04 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5c6eaf17-3ae1-4ee7-b022-ddc56286b733 tempest-VolumesTestJSON-1658208865 None] Created volume successfully. Apr 28 16:12:05 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" returned: 0 in 1.633s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:05 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 Apr 28 16:12:05 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (846aadbc-db58-431a-9ba5-11819a21b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdc2646-fe2f-4a9d-b484-33cfb7f687f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdc2646-fe2f-4a9d-b484-33cfb7f687f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748370143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625e7cfb-ec5e-4650-80d5-0e00a4169a7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:06Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d884d-9416-43ba-809c-14c6f0c1abd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144d884d-9416-43ba-809c-14c6f0c1abd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:06 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23aa0c-063d-426a-b9e6-6702b8b1b8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23aa0c-063d-426a-b9e6-6702b8b1b8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625e7cfb-ec5e-4650-80d5-0e00a4169a7a', 'volume_name': 'volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0571a0ed-fe93-4a41-9896-5895edea4cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0571a0ed-fe93-4a41-9896-5895edea4cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df624cab-c7a5-4200-b540-2db120917939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:06 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Volume 625e7cfb-ec5e-4650-80d5-0e00a4169a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a', 'volume_size': 1} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748370143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625e7cfb-ec5e-4650-80d5-0e00a4169a7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db8a74ec4ebc42a7bf3ddeb6b76ae4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:06Z,use_quota=True,user_id='f8e8fa0e355146f19b7e93c6867c9f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Creating volume 625e7cfb-ec5e-4650-80d5-0e00a4169a7a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:06 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8" returned: 0 in 1.592s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:06 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a 1073741824 Apr 28 16:12:06 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:06 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8 Apr 28 16:12:06 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:07 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a.08edccc1-de76-4020-a844-5e93503aa8a8" returned: 0 in 1.129s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-08edccc1-de76-4020-a844-5e93503aa8a8" released by "_delete_snapshot" :: held 6.240s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" released by "delete_snapshot" :: held 6.296s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:08 devstack cinder-volume[84171]: WARNING cinder.quota [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1452376389 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1452376389, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:08 devstack cinder-volume[84171]: WARNING cinder.quota [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1452376389 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1452376389, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:08 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['67432faa-3c2d-4a77-840d-f7db836bfd9b', '3dc6a9f1-e4f3-4e62-bb4d-b10512071002', '6ba1a3c9-d168-4d9f-bc6e-1e87b5ecf5c4', 'c85a68b6-8d33-41a7-8db9-1353f13e0ac5'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:08 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a 1073741824" returned: 0 in 1.606s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:08 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['079bf7ad-f4da-40c2-890f-536eb74eaefd', '9a6f580e-4019-4e40-b7b3-03c25ac8a84e', '22dd94f7-b157-4a78-9322-5c5c105c50a8', '8dae396e-4a4d-415c-970f-8423ae752387'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:08 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a Apr 28 16:12:08 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:08 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2c9d1898-8998-498d-8b37-d0c3317da80b tempest-GroupSnapshotsTest-1217726435 None] group_snapshot acf8c3bc-7d62-4a6e-b8e6-8efa0c7c4b90: deleted successfully Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:09 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" returned: 0 in 0.825s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ecba8-726f-4500-9018-2c1c021755d6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df624cab-c7a5-4200-b540-2db120917939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a8e038-4ed5-457a-a1fc-1efc9d0c5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:09 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Volume volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a (625e7cfb-ec5e-4650-80d5-0e00a4169a7a): created successfully Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a8e038-4ed5-457a-a1fc-1efc9d0c5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Flow 'volume_create_manager' (846aadbc-db58-431a-9ba5-11819a21b8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:09 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-df2d8551-3bd5-420b-82da-e0f44231e9c9 tempest-VolumesTestJSON-1658208865 None] Created volume successfully. Apr 28 16:12:09 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c Apr 28 16:12:09 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:10 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c" returned: 0 in 1.371s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:10 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c Apr 28 16:12:10 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-625e7cfb-ec5e-4650-80d5-0e00a4169a7a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-625e7cfb-ec5e-4650-80d5-0e00a4169a7a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-quobyte-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddcf42-d77f-4ce2-9765-8b2cde85f8ea]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:11 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98109163-9a2c-47f8-a964-10fd969cd40c" returned: 0 in 0.958s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-98109163-9a2c-47f8-a964-10fd969cd40c" released by "delete_volume" :: held 2.427s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:11 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a Apr 28 16:12:11 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[54600c5a-a683-437b-9885-dd203b3a7665]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:11 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a Apr 28 16:12:11 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:12 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" returned: 0 in 0.973s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:12 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a Apr 28 16:12:12 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:12 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" returned: 0 in 0.973s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:12 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a Apr 28 16:12:12 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:13 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" returned: 0 in 0.963s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:13 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-dee4ca3a-da8b-4f31-9a25-0943b63a3b8a" released by "delete_volume" :: held 2.049s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:13 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" returned: 0 in 1.372s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:13 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-625e7cfb-ec5e-4650-80d5-0e00a4169a7a" released by "delete_volume" :: held 2.427s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['2f85341d-bb43-4b26-860e-a8325cc424e8'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:14 devstack cinder-volume[84171]: WARNING cinder.quota [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1452376389 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1452376389, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Created reservations ['76401566-88bd-4d47-8449-0ec9596ee91f', '446c5244-6d94-4b33-bdb4-db99be3fee64', 'bed0626c-9ba5-494a-bc82-f9e7b51447cc', 'a8491855-0de7-4390-bf32-ea9ab721bc0e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['269b4ffa-e300-4c3a-8290-22b08d6007f3', '4ae2d1de-66db-4fa1-afa6-48e8d2903b32', 'b62c4ac5-67ca-41df-9f62-3d216d92bc32', 'd573ffbb-3d37-4bdb-ba45-e412a6fb3d04'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:14 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:14 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['5d0867b2-3e3c-4c62-9583-ee4d91d8fdd7', '1c349f38-0c78-4a4b-b5cc-dba9505f284d', '6b084244-234d-429c-bc93-ba91d063618c', 'd9790f89-86ac-44d7-a4f0-84f064cc2748'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:14 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:14 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-quobyte-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" acquired by "delete_volume" :: waited 0.101s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e49e1-e3a6-4a77-a0f2-c13feec6c1fa]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:15 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.588s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Deleted volume successfully. Apr 28 16:12:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e09b9129-4638-443f-a4dc-a0ddcef33797 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-625e7cfb-ec5e-4650-80d5-0e00a4169a7a-delete_volume" released by "delete_volume" :: held 4.414s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:15 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 Apr 28 16:12:15 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:16 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.762s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:16 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-71787cba-eb42-4558-bea3-15eac81414b5 tempest-GroupSnapshotsTest-1217726435 None] Delete group completed successfully. Apr 28 16:12:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-93154445-bec6-4ec0-abaf-e969bf5f9169 tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-263349807: creating Apr 28 16:12:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-93154445-bec6-4ec0-abaf-e969bf5f9169 tempest-GroupSnapshotsTest-1217726435 None] Group tempest-GroupSnapshotsTest-Group-263349807: created successfully Apr 28 16:12:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-93154445-bec6-4ec0-abaf-e969bf5f9169 tempest-GroupSnapshotsTest-1217726435 None] Create group completed successfully. Apr 28 16:12:17 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" returned: 0 in 1.656s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:17 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03 Apr 28 16:12:17 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:17 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" returned: 0 in 0.723s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03" released by "delete_volume" :: held 2.517s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Created reservations ['4f965153-d0ed-4674-9840-fdde17ef9867', 'b37fdce2-7a2f-4975-85b5-4904aa42c1c4', '3b0bebc5-4df6-4c85-9d69-2edae32d5a05', '3f9eb240-dd48-46e1-ad26-7bab921ca362'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:18 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:18 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (0873b290-111f-4a2a-80c7-7ce013a11ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1068e9b-7637-4f88-abbb-38ac615fdfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1068e9b-7637-4f88-abbb-38ac615fdfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246978335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9deb02bb-482e-42dc-a455-7eee24c1ebaf,host='devstack@QuobyteHD#QuobyteHD',id=7ece3fd6-9b8f-43c3-b316-30e6cc395709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:18Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8115689e-1fa4-4c38-b959-831074fb3d8a),volume_type_id=8115689e-1fa4-4c38-b959-831074fb3d8a)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc6098-f0af-4a68-be1f-b3aea36f237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcc6098-f0af-4a68-be1f-b3aea36f237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2ff308-b6fc-4d35-a741-5dce487b5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2ff308-b6fc-4d35-a741-5dce487b5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ece3fd6-9b8f-43c3-b316-30e6cc395709', 'volume_name': 'volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8544724c-7319-45ba-bb0a-023a9a799033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8544724c-7319-45ba-bb0a-023a9a799033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03eddc4-3577-4c95-9a8a-bb345a9ae691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:18 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Volume 7ece3fd6-9b8f-43c3-b316-30e6cc395709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709', 'volume_size': 1} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9deb02bb-482e-42dc-a455-7eee24c1ebaf,created_at=2026-04-28T14:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-246978335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9deb02bb-482e-42dc-a455-7eee24c1ebaf,host='devstack@QuobyteHD#QuobyteHD',id=7ece3fd6-9b8f-43c3-b316-30e6cc395709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c3e81e961400c98330470074a90c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:18Z,use_quota=True,user_id='62b9156d6c5f4ec092dbaa19c87cd1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8115689e-1fa4-4c38-b959-831074fb3d8a),volume_type_id=8115689e-1fa4-4c38-b959-831074fb3d8a)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Creating volume 7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:18 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:18 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 1073741824 Apr 28 16:12:18 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-7bda7554-8cbb-447a-8079-cd05dc2b17a8-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-7bda7554-8cbb-447a-8079-cd05dc2b17a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:18 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "cinder-quobyte-7bda7554-8cbb-447a-8079-cd05dc2b17a8" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.695s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Deleted volume successfully. Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-7bda7554-8cbb-447a-8079-cd05dc2b17a8" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c1cd4360-dc7f-48c0-a101-5c463a432bc2 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-e93253b8-9d9f-4c4b-bde1-8e9dd4384d03-delete_volume" released by "delete_volume" :: held 3.692s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aba4ac-0f92-490d-9266-ad93928bf133]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:18 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 Apr 28 16:12:18 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:19 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 1073741824" returned: 0 in 0.942s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:19 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 Apr 28 16:12:19 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:19 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8" returned: 0 in 0.928s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:19 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8 Apr 28 16:12:19 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:20 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709" returned: 0 in 0.842s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03eddc4-3577-4c95-9a8a-bb345a9ae691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28663a34-e3aa-4ced-9815-7da856771123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Volume volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 (7ece3fd6-9b8f-43c3-b316-30e6cc395709): created successfully Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28663a34-e3aa-4ced-9815-7da856771123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Flow 'volume_create_manager' (0873b290-111f-4a2a-80c7-7ce013a11ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:20 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d99e8911-1588-4cd0-8f38-2733e2742e7e tempest-GroupSnapshotsTest-1217726435 None] Created volume successfully. Apr 28 16:12:20 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7bda7554-8cbb-447a-8079-cd05dc2b17a8" returned: 0 in 0.823s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-quobyte-7bda7554-8cbb-447a-8079-cd05dc2b17a8" released by "delete_volume" :: held 1.810s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Created reservations ['4a9d3064-06ed-47d2-b349-eb31ba47d6e0', '421f653d-1b0f-4a2c-931e-b65f871d4a9d', '5bc4e411-49a1-4942-9212-d8165018ae7d', 'b00f3728-0b4c-4e86-8b1d-dc763802bec5'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:20 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:20 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Flow 'volume_create_manager' (abbcefa8-26be-4898-b44c-7408458bc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb39a25d-0a18-4950-a356-ac48ecbf7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb39a25d-0a18-4950-a356-ac48ecbf7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:20Z,deleted=False,deleted_at=None,display_description='',display_name='0d513c5a-e990-4aae-86dd-28f8ed179c31-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f6d38-8465-44db-a167-943a4e68113b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd58829f4474f943a086dc0474d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:21Z,use_quota=True,user_id='e962846d36db4d3cb3362b1aa0c1ab09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47edfdc5-fce1-436d-8f58-041067ecd56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47edfdc5-fce1-436d-8f58-041067ecd56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452c3cad-9ec1-485d-aec5-e5d9d14a3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452c3cad-9ec1-485d-aec5-e5d9d14a3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9f6d38-8465-44db-a167-943a4e68113b', 'volume_name': 'volume-4e9f6d38-8465-44db-a167-943a4e68113b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed8213-1611-45fb-9cff-d0672ec87a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aed8213-1611-45fb-9cff-d0672ec87a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a011f274-30a9-46e2-8be8-c33e6b068917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:20 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume 4e9f6d38-8465-44db-a167-943a4e68113b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9f6d38-8465-44db-a167-943a4e68113b', 'volume_size': 1} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:20Z,deleted=False,deleted_at=None,display_description='',display_name='0d513c5a-e990-4aae-86dd-28f8ed179c31-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f6d38-8465-44db-a167-943a4e68113b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd58829f4474f943a086dc0474d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:21Z,use_quota=True,user_id='e962846d36db4d3cb3362b1aa0c1ab09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Creating volume 4e9f6d38-8465-44db-a167-943a4e68113b {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:20 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:20 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] GroupSnapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: creating. Apr 28 16:12:20 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b 1073741824 Apr 28 16:12:20 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Group snapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: creating. {{(pid=84171) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 16:12:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:21 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.891s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:21 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Deleted volume successfully. Apr 28 16:12:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ae146398-48d4-4f56-9f84-55578d71d217 tempest-VolumesTestJSON-1658208865 None] Lock "cinder-7bda7554-8cbb-447a-8079-cd05dc2b17a8-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b 1073741824" returned: 0 in 1.148s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:22 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:22 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b Apr 28 16:12:22 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:23 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b" returned: 0 in 0.983s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.121s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a011f274-30a9-46e2-8be8-c33e6b068917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9f6d38-8465-44db-a167-943a4e68113b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b3d0f9-d860-43ae-aa59-1c0550b33bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Creating offline snapshot 4f0e3f05-76e3-456c-94e9-b2f8e0d5744e of volume 7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b2fe0-e56f-44d4-b785-d994fffa898a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume volume-4e9f6d38-8465-44db-a167-943a4e68113b (4e9f6d38-8465-44db-a167-943a4e68113b): created successfully Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b3d0f9-d860-43ae-aa59-1c0550b33bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Flow 'volume_create_manager' (abbcefa8-26be-4898-b44c-7408458bc407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-fe603df5-6edd-425a-b38d-87709984b996 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Created volume successfully. Apr 28 16:12:23 devstack sudo[87287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 Apr 28 16:12:23 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:24 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709" returned: 0 in 1.161s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:24 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e 1G Apr 28 16:12:24 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:25 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e 1G" returned: 0 in 1.489s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:25 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e Apr 28 16:12:25 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:26 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" returned: 0 in 1.059s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:26 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:12:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:26 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e Apr 28 16:12:26 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:27 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" returned: 0 in 0.812s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:27 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=111,cinder:INSERT=26,cinder:UPDATE=125,cinder:DELETE=5 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:12:27 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=115,cinder:SELECT=107,cinder:INSERT=31,cinder:DELETE=8 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:12:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:27 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info Apr 28 16:12:27 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:28 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info" returned: 0 in 0.899s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:28 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:12:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:28 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info Apr 28 16:12:28 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:29 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.info" returned: 0 in 0.653s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.217s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.949s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3bf1d0-cd63-4ebc-aa1d-8cd5bf76942a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d77edfbc-a371-413d-8dbc-b9066687b943 tempest-GroupSnapshotsTest-1217726435 None] group_snapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: created successfully Apr 28 16:12:29 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b Apr 28 16:12:29 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] group_snapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: deleting Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] group_snapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: deleting {{(pid=84171) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Deleting offline snapshot 4f0e3f05-76e3-456c-94e9-b2f8e0d5744e of volume 7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:12:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] snapshot_file for this snap is: volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f316049-6190-4a63-a74d-0fbecb849794]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:30 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e Apr 28 16:12:30 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:30 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b" returned: 0 in 1.212s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.243s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207', 'name': 'volume-4e9f6d38-8465-44db-a167-943a4e68113b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '958197a1-4552-4e60-b2b8-3e23f34dbfbb', 'enforce_multipath': True} {{(pid=84171) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 16:12:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-85043499-bcc6-4b70-9ed0-b900a43ed78f req-a0458682-9c02-44a5-b136-aab1aeeeb339 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] attachment_update completed successfully. Apr 28 16:12:30 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" returned: 0 in 0.896s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c9acd5-2469-4394-9d00-3f9c7bedf68f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:31 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 Apr 28 16:12:31 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:31 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709" returned: 0 in 0.810s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:31 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e Apr 28 16:12:31 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:32 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" returned: 0 in 0.859s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:32 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e Apr 28 16:12:32 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e6f9a101-6be1-49d5-ba89-68d9fcc25505 tempest-GroupsV320Test-1153293365 None] Group tempest-GroupsV320Test-Group-1258668549: creating Apr 28 16:12:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e6f9a101-6be1-49d5-ba89-68d9fcc25505 tempest-GroupsV320Test-1153293365 None] Group tempest-GroupsV320Test-Group-1258668549: created successfully Apr 28 16:12:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e6f9a101-6be1-49d5-ba89-68d9fcc25505 tempest-GroupsV320Test-1153293365 None] Create group completed successfully. Apr 28 16:12:33 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709.4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" returned: 0 in 0.658s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-4f0e3f05-76e3-456c-94e9-b2f8e0d5744e" released by "_delete_snapshot" :: held 3.356s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" released by "delete_snapshot" :: held 3.391s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:33 devstack cinder-volume[84171]: WARNING cinder.quota [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-9988582 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-9988582, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:33 devstack cinder-volume[84171]: WARNING cinder.quota [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-9988582 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-9988582, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:33 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['9e286409-9af2-4961-a536-1e75869a4ded', 'f975c3f0-2450-4d90-807b-a766c1c92342', '2fc2214f-75da-4064-8135-68b54088a3c0', 'd15a3428-970a-4f7c-86d6-77be28b9f582'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-685130b0-e4fe-454c-9cc4-595d6378ddde tempest-GroupSnapshotsTest-1217726435 None] group_snapshot 238aaf3e-ad81-4883-9579-60f9d1c429c8: deleted successfully Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Flow 'volume_create_manager' (456c6ad1-e175-401b-9eb0-4377f14f78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967fc3c0-687a-4f96-b80c-f293dd275a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967fc3c0-687a-4f96-b80c-f293dd275a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1438882615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79ea96dee9f4aadb984dc9c6989516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:34Z,use_quota=True,user_id='4c72d643e22e4f7596c11bbff792b1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e4d54-7f3e-4dcd-a44b-5a5b9686a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e4d54-7f3e-4dcd-a44b-5a5b9686a867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30d88ce-fec8-43ad-8c3a-435542daf322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30d88ce-fec8-43ad-8c3a-435542daf322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724', 'volume_name': 'volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d82acc3-9db0-41b5-a6e5-7d2d94db0a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d82acc3-9db0-41b5-a6e5-7d2d94db0a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b11f76-4315-484c-8a9c-e742f20aa8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:34 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Volume 1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724', 'volume_size': 1} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1438882615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79ea96dee9f4aadb984dc9c6989516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:34Z,use_quota=True,user_id='4c72d643e22e4f7596c11bbff792b1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Creating volume 1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:34 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:34 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 1073741824 Apr 28 16:12:34 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843708e-b5cb-4bcc-873b-a918c0dbff42]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Created reservations ['92c1e249-b96d-410e-93c1-a19e7ee62a19'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:34 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 Apr 28 16:12:34 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:34 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:34 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:35 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 1073741824" returned: 0 in 0.945s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:35 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 Apr 28 16:12:35 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:35 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709" returned: 0 in 0.789s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:35 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.684s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:35 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-12a56333-9a2c-4ad5-b147-4b6d6cb01ede tempest-GroupsV320Test-1153293365 None] Delete group completed successfully. Apr 28 16:12:35 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709 Apr 28 16:12:35 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:36 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" returned: 0 in 0.861s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b11f76-4315-484c-8a9c-e742f20aa8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cbcbd5-d2a1-4d79-93f5-663fcb21cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Volume volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 (1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724): created successfully Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cbcbd5-d2a1-4d79-93f5-663fcb21cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Flow 'volume_create_manager' (456c6ad1-e175-401b-9eb0-4377f14f78ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-61f53583-2351-4afb-8b9a-44090faefe96 tempest-ServersNegativeTestJSON-1011523132 None] Created volume successfully. Apr 28 16:12:36 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ece3fd6-9b8f-43c3-b316-30e6cc395709" returned: 0 in 1.199s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "cinder-quobyte-7ece3fd6-9b8f-43c3-b316-30e6cc395709" released by "delete_volume" :: held 2.095s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['ebec04a7-bf77-4384-a2df-b2775609c959'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:36 devstack cinder-volume[84171]: WARNING cinder.quota [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-9988582 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-9988582, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:12:36 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Created reservations ['67a0857c-7f7f-4e30-b694-9bfe4c76b24b', 'a0c5fd2f-88f8-427c-a194-0b1bb8728646', '242eaf74-0286-4417-a82b-d703c62222ac', '29455cd8-90b5-4cdb-a959-a9eff1c409eb'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:37 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:37 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:37 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.869s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:37 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-22c346e8-86f1-4e82-9564-66baae3e65b5 tempest-GroupSnapshotsTest-1217726435 None] Delete group completed successfully. Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Flow 'volume_create_manager' (57ba005e-900b-4062-8420-c9cf7b2bc885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433fa886-e00f-47a5-ae04-abfcd7db9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433fa886-e00f-47a5-ae04-abfcd7db9499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1132565978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c9e9dc-f20d-42a3-8651-e49a08c5d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79ea96dee9f4aadb984dc9c6989516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:38Z,use_quota=True,user_id='4c72d643e22e4f7596c11bbff792b1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b28d33b-5ad1-461f-852f-540d0eea31a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b28d33b-5ad1-461f-852f-540d0eea31a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f91494-d122-4e27-b320-fa568a32f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f91494-d122-4e27-b320-fa568a32f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c9e9dc-f20d-42a3-8651-e49a08c5d838', 'volume_name': 'volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e24161-df4c-4e40-b486-796d9febbfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e24161-df4c-4e40-b486-796d9febbfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3f027-9113-4287-97fc-031785ca43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:38 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Volume 93c9e9dc-f20d-42a3-8651-e49a08c5d838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838', 'volume_size': 1} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1132565978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c9e9dc-f20d-42a3-8651-e49a08c5d838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79ea96dee9f4aadb984dc9c6989516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:38Z,use_quota=True,user_id='4c72d643e22e4f7596c11bbff792b1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Creating volume 93c9e9dc-f20d-42a3-8651-e49a08c5d838 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:38 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:38 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 1073741824 Apr 28 16:12:38 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:39 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 1073741824" returned: 0 in 1.085s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:39 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 Apr 28 16:12:39 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:40 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c3f027-9113-4287-97fc-031785ca43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153e2e9-9273-4cde-b064-4357723979e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Volume volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 (93c9e9dc-f20d-42a3-8651-e49a08c5d838): created successfully Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153e2e9-9273-4cde-b064-4357723979e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Flow 'volume_create_manager' (57ba005e-900b-4062-8420-c9cf7b2bc885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-15ccc264-20bd-448d-a651-c54358fabccd tempest-ServersNegativeTestJSON-1011523132 None] Created volume successfully. Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "cinder-93c9e9dc-f20d-42a3-8651-e49a08c5d838-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-93c9e9dc-f20d-42a3-8651-e49a08c5d838-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "cinder-quobyte-93c9e9dc-f20d-42a3-8651-e49a08c5d838" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-quobyte-93c9e9dc-f20d-42a3-8651-e49a08c5d838" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5eee67-5555-49bd-8611-81407abb2f60]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:42 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 Apr 28 16:12:42 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:43 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838" returned: 0 in 0.866s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:43 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838 Apr 28 16:12:43 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:43 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-93c9e9dc-f20d-42a3-8651-e49a08c5d838" returned: 0 in 0.773s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-quobyte-93c9e9dc-f20d-42a3-8651-e49a08c5d838" released by "delete_volume" :: held 1.687s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:43 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Created reservations ['d01b889a-cc32-47bb-ae7a-91edca185f4a', 'b68de7e7-0d75-4728-bd69-b751215a2116', 'c5e40c60-a2ca-4caa-b706-0101c126c834', 'e9c120ac-fb18-4d40-b6ec-2c449bd8e784'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:44 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:44 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "cinder-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "cinder-quobyte-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-quobyte-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e6b802-2e74-422f-b03d-b5b5d8903d33]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:44 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 Apr 28 16:12:44 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:44 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.884s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:45 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Deleted volume successfully. Apr 28 16:12:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4890f2c6-5709-4812-84a4-0e5bce5a5834 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-93c9e9dc-f20d-42a3-8651-e49a08c5d838-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:45 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" returned: 0 in 0.877s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:45 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724 Apr 28 16:12:45 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:46 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" returned: 0 in 1.098s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-quobyte-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724" released by "delete_volume" :: held 2.060s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Created reservations ['02bdb19e-baf3-4089-a20d-72c9f738364a', '29a071e4-3542-4cf9-81d7-1579c262b0e4', 'ce25c83d-1540-4491-8a45-b9a04d1218c6', '3d40eb70-c979-44a9-bae3-7f5f454addc9'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:46 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:46 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:47 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.844s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:47 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:47 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Deleted volume successfully. Apr 28 16:12:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5aa82253-8246-49c4-8394-93dbe67ed742 tempest-ServersNegativeTestJSON-1011523132 None] Lock "cinder-1973d05f-8fc4-4e0a-b5fc-8cf3d81fc724-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Flow 'volume_create_manager' (6fc89bfb-3d11-49e5-8f4d-99bb9ab941bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc500b2-34fa-4b2d-bd50-0c0fd62cce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc500b2-34fa-4b2d-bd50-0c0fd62cce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-610102012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffecac6-5af6-40c9-86b0-8b1ced56ee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0c9982006047b9aa50e293816e23a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:53Z,use_quota=True,user_id='0cb6313190c645978fdc12a2112d4bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ac6c28e-f6a0-4c99-8052-2a49855e6a87),volume_type_id=6ac6c28e-f6a0-4c99-8052-2a49855e6a87)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edadb818-bcd4-4958-92ac-465886083c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edadb818-bcd4-4958-92ac-465886083c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7313f2-6019-461b-af47-8eb22352ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7313f2-6019-461b-af47-8eb22352ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffecac6-5af6-40c9-86b0-8b1ced56ee06', 'volume_name': 'volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742546e7-2b2e-497b-9d6c-3a1f11c05a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742546e7-2b2e-497b-9d6c-3a1f11c05a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a95b83f-7267-46d6-afbd-a68d27fb21fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:53 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Volume dffecac6-5af6-40c9-86b0-8b1ced56ee06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06', 'volume_size': 1} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-610102012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffecac6-5af6-40c9-86b0-8b1ced56ee06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0c9982006047b9aa50e293816e23a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:53Z,use_quota=True,user_id='0cb6313190c645978fdc12a2112d4bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ac6c28e-f6a0-4c99-8052-2a49855e6a87),volume_type_id=6ac6c28e-f6a0-4c99-8052-2a49855e6a87)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Creating volume dffecac6-5af6-40c9-86b0-8b1ced56ee06 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:53 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:53 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 1073741824 Apr 28 16:12:53 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:54 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 1073741824" returned: 0 in 1.075s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:54 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 Apr 28 16:12:54 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:55 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06" returned: 0 in 0.948s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a95b83f-7267-46d6-afbd-a68d27fb21fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcec7c7-2d71-45b6-8b00-a31cfc76ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:55 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Volume volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 (dffecac6-5af6-40c9-86b0-8b1ced56ee06): created successfully Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcec7c7-2d71-45b6-8b00-a31cfc76ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Flow 'volume_create_manager' (6fc89bfb-3d11-49e5-8f4d-99bb9ab941bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-420c7996-6c3f-4334-893d-77f8be9dd54a tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Created volume successfully. Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Flow 'volume_create_manager' (4f3a42c7-3531-43b1-aac4-75610323dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1726ee1-747e-4dcf-8ddb-bf1c21c558d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1726ee1-747e-4dcf-8ddb-bf1c21c558d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1098907473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c60f1c-1cab-44cc-a2a0-ac89967d0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e91e25ec54271ac89f1f7e00b5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:57Z,use_quota=True,user_id='a6646b60466443f6a449d36230b2329c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dd6ec6-fb62-49fb-8528-0bc168b95049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59dd6ec6-fb62-49fb-8528-0bc168b95049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ea93ac-4fd6-47a4-b650-a11daa0d7fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ea93ac-4fd6-47a4-b650-a11daa0d7fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c60f1c-1cab-44cc-a2a0-ac89967d0a58', 'volume_name': 'volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aaf400-d308-444c-9b90-80d19b05c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4aaf400-d308-444c-9b90-80d19b05c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5278a076-1baf-4bb6-991f-4b6a2f5f3e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:56 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Volume 80c60f1c-1cab-44cc-a2a0-ac89967d0a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58', 'volume_size': 1} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1098907473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c60f1c-1cab-44cc-a2a0-ac89967d0a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e91e25ec54271ac89f1f7e00b5e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:12:57Z,use_quota=True,user_id='a6646b60466443f6a449d36230b2329c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Creating volume 80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:12:56 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:12:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:57 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 1073741824 Apr 28 16:12:57 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:57 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:12:57 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:58 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 1073741824" returned: 0 in 1.481s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:58 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 Apr 28 16:12:58 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:58 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.051s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:12:58 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2883c89e-84d3-408d-851e-b3063d8d1987 tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Retype volume completed successfully. Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "cinder-dffecac6-5af6-40c9-86b0-8b1ced56ee06-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "cinder-dffecac6-5af6-40c9-86b0-8b1ced56ee06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "cinder-quobyte-dffecac6-5af6-40c9-86b0-8b1ced56ee06" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "cinder-quobyte-dffecac6-5af6-40c9-86b0-8b1ced56ee06" acquired by "delete_volume" :: waited 0.041s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cc51f-3317-404d-835d-c54796a305d7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:12:59 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 Apr 28 16:12:59 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:12:59 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" returned: 0 in 0.697s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5278a076-1baf-4bb6-991f-4b6a2f5f3e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa80f218-e15c-47fc-a517-39720fcac662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:12:59 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Volume volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 (80c60f1c-1cab-44cc-a2a0-ac89967d0a58): created successfully Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa80f218-e15c-47fc-a517-39720fcac662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:12:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Flow 'volume_create_manager' (4f3a42c7-3531-43b1-aac4-75610323dbda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:12:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-62cc9700-5e09-4147-a1ab-832485b60eb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Created volume successfully. Apr 28 16:13:00 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06" returned: 0 in 0.949s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:00 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06 Apr 28 16:13:00 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Creating offline snapshot b3709629-582c-463a-849f-e4f9a2a9c9b8 of volume 80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[643bc0d0-6762-49f6-a551-88da63dd0cc3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:00 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:00 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:00 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 Apr 28 16:13:00 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:01 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-dffecac6-5af6-40c9-86b0-8b1ced56ee06" returned: 0 in 1.494s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "cinder-quobyte-dffecac6-5af6-40c9-86b0-8b1ced56ee06" released by "delete_volume" :: held 2.509s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:01 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.995s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:01 devstack cinder-volume[84171]: WARNING cinder.quota [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:01 devstack cinder-volume[84171]: WARNING cinder.quota [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Created reservations ['9cecb65f-2e45-43d0-af8f-2681e9475cd5', 'aefbbf2f-a082-4a93-b698-f10ec0c5eb14', 'c2eea9b2-9a81-473c-97f4-07319f922641', '525136ea-19e1-4e97-9a3b-a9122c188aae'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:01 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:01 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:01 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" returned: 0 in 1.278s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:01 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 1G Apr 28 16:13:01 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:02 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.142s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:02 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:02 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Deleted volume successfully. Apr 28 16:13:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76025eee-43d8-4c81-83f8-59c824d89c9b tempest-VolumeRetypeWithoutMigrationTest-366490807 None] Lock "cinder-dffecac6-5af6-40c9-86b0-8b1ced56ee06-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:03 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 1G" returned: 0 in 1.408s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:03 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 Apr 28 16:13:03 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:04 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8" returned: 0 in 0.938s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:04 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 is being set with open permissions: ugo+rw Apr 28 16:13:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:04 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 Apr 28 16:13:04 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:05 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8" returned: 0 in 1.022s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:05 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info Apr 28 16:13:05 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:05 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:05 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info is being set with open permissions: ugo+rw Apr 28 16:13:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:05 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info Apr 28 16:13:05 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:06 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.info" returned: 0 in 0.741s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.177s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1c0f430b-5c56-4745-ac6e-c92f26e76ac3 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Create snapshot completed successfully Apr 28 16:13:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-206cdbda-d926-4f64-ae97-b37fbc6f7f51 tempest-GroupSnapshotsV319Test-1443518029 None] Group tempest-GroupSnapshotsV319Test-Group-66889351: creating Apr 28 16:13:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-206cdbda-d926-4f64-ae97-b37fbc6f7f51 tempest-GroupSnapshotsV319Test-1443518029 None] Group tempest-GroupSnapshotsV319Test-Group-66889351: created successfully Apr 28 16:13:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-206cdbda-d926-4f64-ae97-b37fbc6f7f51 tempest-GroupSnapshotsV319Test-1443518029 None] Create group completed successfully. Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "cinder-b3709629-582c-463a-849f-e4f9a2a9c9b8-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-b3709629-582c-463a-849f-e4f9a2a9c9b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "cinder-quobyte-b3709629-582c-463a-849f-e4f9a2a9c9b8" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-b3709629-582c-463a-849f-e4f9a2a9c9b8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Deleting offline snapshot b3709629-582c-463a-849f-e4f9a2a9c9b8 of volume 80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] snapshot_file for this snap is: volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c4a98-3e32-4f79-9a9c-9bbe4b6744de]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:07 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 Apr 28 16:13:07 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:08 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8" returned: 0 in 0.785s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d05ca78-87a7-4108-b3ae-2a0183cb20ce]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Flow 'volume_create_manager' (2ba3b4d5-5169-4e33-a2df-1e69acda06bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2175deb-3684-4a98-8c96-e95423e00873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:08 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 Apr 28 16:13:08 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2175deb-3684-4a98-8c96-e95423e00873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681224171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cd36364-5f26-4363-8370-a7901a972026,host='devstack@QuobyteHD#QuobyteHD',id=31c2aabc-d581-480a-95a3-1458f4c1607f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472d4f2b598e4ec4ad9786baf408a77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:08Z,use_quota=True,user_id='2e7ae0a5639448aabf9d9694d30b21fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09b78b9-68a2-42d6-a9e6-b8531a343029),volume_type_id=d09b78b9-68a2-42d6-a9e6-b8531a343029)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c618bfef-19bf-46b2-92a5-988e2a9dc69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c618bfef-19bf-46b2-92a5-988e2a9dc69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e33e106-65f8-4cb7-8f1d-2b70fa455758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e33e106-65f8-4cb7-8f1d-2b70fa455758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c2aabc-d581-480a-95a3-1458f4c1607f', 'volume_name': 'volume-31c2aabc-d581-480a-95a3-1458f4c1607f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc05294-5fa6-437b-871a-dd258ceaceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc05294-5fa6-437b-871a-dd258ceaceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3c6544-e14f-4919-875b-418eb5a862ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:08 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Volume 31c2aabc-d581-480a-95a3-1458f4c1607f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c2aabc-d581-480a-95a3-1458f4c1607f', 'volume_size': 1} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7cd36364-5f26-4363-8370-a7901a972026,created_at=2026-04-28T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681224171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7cd36364-5f26-4363-8370-a7901a972026,host='devstack@QuobyteHD#QuobyteHD',id=31c2aabc-d581-480a-95a3-1458f4c1607f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472d4f2b598e4ec4ad9786baf408a77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:08Z,use_quota=True,user_id='2e7ae0a5639448aabf9d9694d30b21fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d09b78b9-68a2-42d6-a9e6-b8531a343029),volume_type_id=d09b78b9-68a2-42d6-a9e6-b8531a343029)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Creating volume 31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:08 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:08 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f 1073741824 Apr 28 16:13:08 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:09 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" returned: 0 in 0.797s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:09 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 Apr 28 16:13:09 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f 1073741824" returned: 0 in 1.039s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:09 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:09 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f Apr 28 16:13:09 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:10 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8" returned: 0 in 1.001s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:10 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8 Apr 28 16:13:10 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:10 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f" returned: 0 in 0.847s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3c6544-e14f-4919-875b-418eb5a862ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c2aabc-d581-480a-95a3-1458f4c1607f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb02253-2fa3-4538-a53c-04ab87383a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Volume volume-31c2aabc-d581-480a-95a3-1458f4c1607f (31c2aabc-d581-480a-95a3-1458f4c1607f): created successfully Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb02253-2fa3-4538-a53c-04ab87383a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Flow 'volume_create_manager' (2ba3b4d5-5169-4e33-a2df-1e69acda06bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:10 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7ba74b7f-4b8a-433e-99e5-278efe3ee0c7 tempest-GroupSnapshotsV319Test-1443518029 None] Created volume successfully. Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Flow 'volume_create_manager' (fdee8005-09d3-4444-bf50-4dbf9d61ace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee51a2ae-9a34-4384-a57d-d3c16d623f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee51a2ae-9a34-4384-a57d-d3c16d623f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1182512294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f42d542-4fc4-4f22-b071-9fd27ccd84ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312281a7bf244e2ea2cc91182466a5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:11Z,use_quota=True,user_id='7a7f5a1bc3f34afe83c99dd326d9497e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdd73e61-7538-4a7a-b71f-a83c2e45b8d6),volume_type_id=bdd73e61-7538-4a7a-b71f-a83c2e45b8d6)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f5768-0dce-4ddb-a0f4-195b2481398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577f5768-0dce-4ddb-a0f4-195b2481398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a670d38b-f332-407d-9dac-a0d8822ff47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a670d38b-f332-407d-9dac-a0d8822ff47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f42d542-4fc4-4f22-b071-9fd27ccd84ac', 'volume_name': 'volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e75c3c-f4b7-4716-b67f-4dafa1bb8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e75c3c-f4b7-4716-b67f-4dafa1bb8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184c86bc-0745-4505-95e2-2d34a2c94ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:10 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Volume 6f42d542-4fc4-4f22-b071-9fd27ccd84ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac', 'volume_size': 1} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1182512294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f42d542-4fc4-4f22-b071-9fd27ccd84ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='312281a7bf244e2ea2cc91182466a5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:11Z,use_quota=True,user_id='7a7f5a1bc3f34afe83c99dd326d9497e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdd73e61-7538-4a7a-b71f-a83c2e45b8d6),volume_type_id=bdd73e61-7538-4a7a-b71f-a83c2e45b8d6)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Creating volume 6f42d542-4fc4-4f22-b071-9fd27ccd84ac {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:10 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:10 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac 1073741824 Apr 28 16:13:10 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:11 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] GroupSnapshot e4975589-779f-424b-9cc9-36d821318937: creating. Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Group snapshot e4975589-779f-424b-9cc9-36d821318937: creating. {{(pid=84171) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:11 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58.b3709629-582c-463a-849f-e4f9a2a9c9b8" returned: 0 in 1.034s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-b3709629-582c-463a-849f-e4f9a2a9c9b8" released by "_delete_snapshot" :: held 3.778s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" released by "delete_snapshot" :: held 3.805s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Created reservations ['4baa6067-1d07-4bd1-9ddf-043006c0af47', '9a8dc0d3-c07a-4b76-813c-5be3e194d1f2', '50ee87e6-b241-4871-b562-ea86b98a3c3e', '00f4ebb4-d228-49a4-98ec-d602954ab1d3'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:11 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Delete snapshot completed successfully. Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f55b4309-3fe3-459c-818c-43ecc91e70a0 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-b3709629-582c-463a-849f-e4f9a2a9c9b8-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "cinder-80c60f1c-1cab-44cc-a2a0-ac89967d0a58-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-80c60f1c-1cab-44cc-a2a0-ac89967d0a58-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:12 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac 1073741824" returned: 0 in 1.156s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf0e65a-8331-4c31-b2a2-b9217daca5b6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:12 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac Apr 28 16:13:12 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:12 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 Apr 28 16:13:12 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:12 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.784s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Creating offline snapshot 8d408352-0795-44aa-976c-47fd63e801b8 of volume 31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184c86bc-0745-4505-95e2-2d34a2c94ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f312175-2058-4020-abcd-35a4fc2a15d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845d61f-ff77-44e9-8c50-6c6b571c30e4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:12 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Volume volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac (6f42d542-4fc4-4f22-b071-9fd27ccd84ac): created successfully Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f312175-2058-4020-abcd-35a4fc2a15d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Flow 'volume_create_manager' (fdee8005-09d3-4444-bf50-4dbf9d61ace0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:12 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d9c9ae8c-cac3-4c8c-81be-be1e6cc4794c tempest-VolumeTypesAccessTest-314735329 None] Created volume successfully. Apr 28 16:13:13 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f Apr 28 16:13:13 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:13 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" returned: 0 in 0.957s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:13 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58 Apr 28 16:13:13 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:13 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f" returned: 0 in 0.798s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:13 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" returned: 0 in 0.667s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:13 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 1G Apr 28 16:13:13 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-quobyte-80c60f1c-1cab-44cc-a2a0-ac89967d0a58" released by "delete_volume" :: held 1.718s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Created reservations ['849ee5db-4b77-4848-969c-20324bdab911', '6962e5e4-494e-4a51-991f-70137dc22274', 'a9218487-aefb-41d0-befb-3ee9c5a55b47', 'a58e8891-4a20-48c9-88ed-c01a4a1adc7f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:13 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:13 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Acquiring lock "cinder-6f42d542-4fc4-4f22-b071-9fd27ccd84ac-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "cinder-6f42d542-4fc4-4f22-b071-9fd27ccd84ac-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Acquiring lock "cinder-quobyte-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "cinder-quobyte-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457bdd0-79b1-4d4a-99f2-9f251a5edf6e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:14 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac Apr 28 16:13:14 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:14 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.727s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:14 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Deleted volume successfully. Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d70bf4c3-84fa-437b-a1b5-4fdce49cd541 tempest-VolumeSnapshotQuotasNegativeTestJSON-813326343 None] Lock "cinder-80c60f1c-1cab-44cc-a2a0-ac89967d0a58-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:14 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 1G" returned: 0 in 1.053s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c2aabc-d581-480a-95a3-1458f4c1607f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:14 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c2aabc-d581-480a-95a3-1458f4c1607f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 Apr 28 16:13:14 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:15 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" returned: 0 in 0.914s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:15 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac Apr 28 16:13:15 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:15 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c2aabc-d581-480a-95a3-1458f4c1607f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8" returned: 0 in 0.833s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:15 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:15 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 Apr 28 16:13:15 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:15 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" returned: 0 in 0.678s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "cinder-quobyte-6f42d542-4fc4-4f22-b071-9fd27ccd84ac" released by "delete_volume" :: held 1.640s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:15 devstack cinder-volume[84171]: WARNING cinder.quota [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-639422160 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-639422160, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:15 devstack cinder-volume[84171]: WARNING cinder.quota [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-639422160 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-639422160, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Created reservations ['038925d6-8b22-4b54-9071-f509afd5772f', 'e214d74a-6f0d-49ac-8a9b-6c309a329f12', '36433cfd-16f8-45d2-95ed-b395dad9a557', '5e0ce397-888e-4624-ad71-fb16c7bfcf18'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:15 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:15 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:16 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8" returned: 0 in 0.869s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:16 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info Apr 28 16:13:16 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:16 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.908s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:16 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Deleted volume successfully. Apr 28 16:13:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-05a0d81d-c7c3-40e3-891b-f2a98b080f5a tempest-VolumeTypesAccessTest-314735329 None] Lock "cinder-6f42d542-4fc4-4f22-b071-9fd27ccd84ac-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:17 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info" returned: 0 in 0.732s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:17 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:13:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:17 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info Apr 28 16:13:17 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:18 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.info" returned: 0 in 0.989s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.404s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8915bcd5-4814-4a2a-8fdf-564234375607 tempest-GroupSnapshotsV319Test-1443518029 None] group_snapshot e4975589-779f-424b-9cc9-36d821318937: created successfully Apr 28 16:13:19 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] group_snapshot e4975589-779f-424b-9cc9-36d821318937: deleting Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] group_snapshot e4975589-779f-424b-9cc9-36d821318937: deleting {{(pid=84171) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "cinder-quobyte-8d408352-0795-44aa-976c-47fd63e801b8" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-8d408352-0795-44aa-976c-47fd63e801b8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Deleting offline snapshot 8d408352-0795-44aa-976c-47fd63e801b8 of volume 31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] snapshot_file for this snap is: volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a732de07-68da-4c99-9eab-900d48280f93]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:19 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 Apr 28 16:13:19 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:20 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8" returned: 0 in 1.277s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31c2aabc-d581-480a-95a3-1458f4c1607f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:13:20 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[562359b5-c1a9-41d6-ab1d-d7967ea6b6a2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:20 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f Apr 28 16:13:20 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Flow 'volume_create_manager' (5cae371e-0344-4591-a274-eeda5784e436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86f1103-5aee-4247-8370-79c0f159720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86f1103-5aee-4247-8370-79c0f159720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1232430480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f809b89-8e31-4890-8ad1-0af0093b6702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e80651716d43f1bdced1da19484a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:21Z,use_quota=True,user_id='8ab04649ddd94b9b989b904aac49370e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a1062a-ea61-4ba5-9c39-4b8c7ec11126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a1062a-ea61-4ba5-9c39-4b8c7ec11126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94fb451-08f8-4e65-bd77-f602bbc7f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:21 devstack cinder-volume[84171]: DEBUG cinder.image.glance [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Creating Keystone auth plugin from conf {{(pid=84171) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 16:13:22 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f" returned: 0 in 1.579s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:22 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 Apr 28 16:13:22 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94fb451-08f8-4e65-bd77-f602bbc7f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f809b89-8e31-4890-8ad1-0af0093b6702', 'volume_name': 'volume-6f809b89-8e31-4890-8ad1-0af0093b6702', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b9051e-8a2c-4fa8-9214-01ed935d32e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b9051e-8a2c-4fa8-9214-01ed935d32e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc8ac5d-61ee-4d67-b21d-d5c10e11ca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:22 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Volume 6f809b89-8e31-4890-8ad1-0af0093b6702: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f809b89-8e31-4890-8ad1-0af0093b6702', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 16:13:22 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Trying to clone 6f809b89-8e31-4890-8ad1-0af0093b6702 from image 15a518ba-55ac-48ec-8b87-111778c54a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]). {{(pid=84171) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 16:13:23 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 16:13:23 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Image download 20.69 MB at 20.69 MB/s Apr 28 16:13:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc27f6eb-4a8c-4c21-9cca-7d2b8e02269e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:23 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD Apr 28 16:13:23 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:23 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8" returned: 0 in 1.341s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:23 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8 Apr 28 16:13:23 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:24 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD" returned: 0 in 1.017s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b is fetched for user 8ab04649ddd94b9b989b904aac49370e. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc331c-9c7a-4e1b-ab4d-228bd68d3e0b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:24 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD Apr 28 16:13:24 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:24 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f.8d408352-0795-44aa-976c-47fd63e801b8" returned: 0 in 1.038s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-8d408352-0795-44aa-976c-47fd63e801b8" released by "_delete_snapshot" :: held 5.388s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" released by "delete_snapshot" :: held 5.420s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:24 devstack cinder-volume[84171]: WARNING cinder.quota [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1471749715 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1471749715, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:24 devstack cinder-volume[84171]: WARNING cinder.quota [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1471749715 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1471749715, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:24 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] Created reservations ['a1f82b2e-af53-4a2e-91ff-ed80eb350538', '67c5dd58-90ba-4716-8138-89ab474bd7c9', '927e3140-94a9-400b-97b5-c10ca1bff7d5', '63643ce8-6ee0-46d9-80ae-b3878740965b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-334413d1-8bb5-42c7-85ab-31128e3f70cb tempest-GroupSnapshotsV319Test-1443518029 None] group_snapshot e4975589-779f-424b-9cc9-36d821318937: deleted successfully Apr 28 16:13:25 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD" returned: 0 in 0.996s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1232430480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f809b89-8e31-4890-8ad1-0af0093b6702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e80651716d43f1bdced1da19484a2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:21Z,use_quota=True,user_id='8ab04649ddd94b9b989b904aac49370e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Creating volume 6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:25 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1073741824 Apr 28 16:13:25 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:26 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1073741824" returned: 0 in 0.983s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6f0da-bd9c-4727-873c-46f50476b700]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:26 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:26 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:26 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f Apr 28 16:13:26 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:27 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f" returned: 0 in 1.027s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:27 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 0 in 1.079s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:27 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f Apr 28 16:13:27 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Attempting download of 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 6f809b89-8e31-4890-8ad1-0af0093b6702. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c2f2db-16f9-48aa-96f4-bb55ef1d285d]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:27 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov Apr 28 16:13:27 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:28 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-31c2aabc-d581-480a-95a3-1458f4c1607f" returned: 0 in 1.081s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "cinder-quobyte-31c2aabc-d581-480a-95a3-1458f4c1607f" released by "delete_volume" :: held 2.220s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=103,cinder:INSERT=27,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=103,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=3 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:13:28 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov" returned: 0 in 1.030s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Created reservations ['5fe3c185-94f3-4715-8a69-aa6000d88815'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:28 devstack cinder-volume[84171]: WARNING cinder.quota [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1471749715 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1471749715, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Created reservations ['89136bc2-ae3d-4ac6-8472-f15280a79e49', 'e7f267af-02e7-4788-acb0-49655837903a', 'aacc62d0-642b-4de5-8f93-e216c6c47b11', '7cd56c64-f1b0-45a4-8ab0-4e91d132cb0e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:28 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov Apr 28 16:13:28 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:29 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:29 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:30 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov" returned: 1 in 1.462s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_ih5zswov' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8cbd9-618f-4b52-85fd-34828166832b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:30 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.175s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:30 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7caa2228-c827-469e-95b7-1d5802fa9fb2 tempest-GroupSnapshotsV319Test-1443518029 None] Delete group completed successfully. Apr 28 16:13:30 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD Apr 28 16:13:30 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:31 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD" returned: 0 in 1.128s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:31 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] 15a518ba-55ac-48ec-8b87-111778c54a6b was qcow2, converting to raw {{(pid=84171) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 16:13:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:31 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:31 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:33 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 0 in 2.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:33 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_ejiguth1devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:13:33 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Converted 112.00 MB image at 42.60 MB/s Apr 28 16:13:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:33 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1G Apr 28 16:13:33 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:34 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 1G" returned: 0 in 0.744s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c42ce-5ebd-48b2-b58b-a3fcb70108bc]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:34 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:34 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:35 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 0 in 0.905s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:35 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:35 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:36 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 1 in 0.853s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Downloaded image 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 6f809b89-8e31-4890-8ad1-0af0093b6702 successfully. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b for user 8ab04649ddd94b9b989b904aac49370e is deleted. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Marking volume 6f809b89-8e31-4890-8ad1-0af0093b6702 as bootable. {{(pid=84171) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Copying metadata from image 15a518ba-55ac-48ec-8b87-111778c54a6b to 6f809b89-8e31-4890-8ad1-0af0093b6702. {{(pid=84171) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Creating volume glance metadata for volume 6f809b89-8e31-4890-8ad1-0af0093b6702 backed by image 15a518ba-55ac-48ec-8b87-111778c54a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84171) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc8ac5d-61ee-4d67-b21d-d5c10e11ca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f809b89-8e31-4890-8ad1-0af0093b6702', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fc788f-1ddb-4c15-bc0b-80e77cb82356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Volume volume-6f809b89-8e31-4890-8ad1-0af0093b6702 (6f809b89-8e31-4890-8ad1-0af0093b6702): created successfully Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fc788f-1ddb-4c15-bc0b-80e77cb82356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Flow 'volume_create_manager' (5cae371e-0344-4591-a274-eeda5784e436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1a27c934-7fed-4daa-82b6-ab483263be18 tempest-VolumesImageMetadata-1303671673 None] Created volume successfully. Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Acquiring lock "cinder-6f809b89-8e31-4890-8ad1-0af0093b6702-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "cinder-6f809b89-8e31-4890-8ad1-0af0093b6702-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Acquiring lock "cinder-quobyte-6f809b89-8e31-4890-8ad1-0af0093b6702" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "cinder-quobyte-6f809b89-8e31-4890-8ad1-0af0093b6702" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c7e08-27bb-42a5-b3a0-b2a6d5d44b55]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:37 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:37 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:38 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 0 in 0.882s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:38 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:38 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:39 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 1 in 1.103s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:13:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:39 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702 Apr 28 16:13:39 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:40 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f809b89-8e31-4890-8ad1-0af0093b6702" returned: 0 in 0.839s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "cinder-quobyte-6f809b89-8e31-4890-8ad1-0af0093b6702" released by "delete_volume" :: held 2.913s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Created reservations ['7c4314d8-107e-4a4e-a443-092b34b1fc38', '46366cac-b926-4e50-9f08-89271ad4752b', '4aa26dc2-76eb-4c65-885a-80b01d83e583', 'bdbe9a84-cd22-467c-9217-ac09636134c8'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:40 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:40 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:41 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.857s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:41 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Deleted volume successfully. Apr 28 16:13:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a2536d25-4bf1-4bdc-9419-1a384399c263 tempest-VolumesImageMetadata-1303671673 None] Lock "cinder-6f809b89-8e31-4890-8ad1-0af0093b6702-delete_volume" released by "delete_volume" :: held 4.074s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Flow 'volume_create_manager' (a914c0a6-b57b-41a6-812a-a34a8c0fb2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621ac0bb-1a97-48b8-ab5b-2757b786216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621ac0bb-1a97-48b8-ab5b-2757b786216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40f79d6-ea52-48c1-ab15-450596953348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd58829f4474f943a086dc0474d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:44Z,use_quota=True,user_id='e962846d36db4d3cb3362b1aa0c1ab09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9654b866-0ec5-4416-825a-b4829c424422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9654b866-0ec5-4416-825a-b4829c424422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf74d6e5-3da0-4f9d-8f4f-353b9aabafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:43 devstack cinder-volume[84171]: DEBUG cinder.image.glance [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Creating Keystone auth plugin from conf {{(pid=84171) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf74d6e5-3da0-4f9d-8f4f-353b9aabafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a40f79d6-ea52-48c1-ab15-450596953348', 'volume_name': 'volume-a40f79d6-ea52-48c1-ab15-450596953348', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367bbdb2-d235-43bb-8f54-68f4a5d4dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (367bbdb2-d235-43bb-8f54-68f4a5d4dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0221e5-7fef-4150-b1b2-66014b3694e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:44 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume a40f79d6-ea52-48c1-ab15-450596953348: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a40f79d6-ea52-48c1-ab15-450596953348', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Trying to clone a40f79d6-ea52-48c1-ab15-450596953348 from image 15a518ba-55ac-48ec-8b87-111778c54a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]). {{(pid=84171) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 16:13:44 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 16:13:44 devstack cinder-volume[84171]: INFO cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Image download 20.69 MB at 20.69 MB/s Apr 28 16:13:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-81529234-367f-42a6-9043-2770ea5e1e0e tempest-GroupsTest-1386922833 None] Group tempest-Group1-1357111715: creating Apr 28 16:13:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-81529234-367f-42a6-9043-2770ea5e1e0e tempest-GroupsTest-1386922833 None] Group tempest-Group1-1357111715: created successfully Apr 28 16:13:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525144f-bbc7-4ceb-b34b-7af5a3bbaa41]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-81529234-367f-42a6-9043-2770ea5e1e0e tempest-GroupsTest-1386922833 None] Create group completed successfully. Apr 28 16:13:45 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD Apr 28 16:13:45 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:46 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD" returned: 0 in 1.010s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:46 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b is fetched for user e962846d36db4d3cb3362b1aa0c1ab09. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 16:13:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd32452-76c1-4f56-845a-70fb877324c7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3e1228a3-35a9-4de3-b0d6-f35193d3f6b9 tempest-GroupsTest-1386922833 None] Group tempest-Group2-242468636: creating Apr 28 16:13:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3e1228a3-35a9-4de3-b0d6-f35193d3f6b9 tempest-GroupsTest-1386922833 None] Group tempest-Group2-242468636: created successfully Apr 28 16:13:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3e1228a3-35a9-4de3-b0d6-f35193d3f6b9 tempest-GroupsTest-1386922833 None] Create group completed successfully. Apr 28 16:13:46 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD Apr 28 16:13:46 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:47 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD" returned: 0 in 0.845s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a40f79d6-ea52-48c1-ab15-450596953348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd58829f4474f943a086dc0474d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:44Z,use_quota=True,user_id='e962846d36db4d3cb3362b1aa0c1ab09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Creating volume a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:47 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:47 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1073741824 Apr 28 16:13:47 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:48 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (b047e445-31d0-4a56-b06f-5237115295bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803e8d6-2de9-41f4-8ac4-3e0986254da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1073741824" returned: 0 in 1.280s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c803e8d6-2de9-41f4-8ac4-3e0986254da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324307271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=126e9987-5774-48f3-b74d-f45feebeb976,host='devstack@QuobyteHD#QuobyteHD',id=7b706af9-89fa-4042-934b-1c508cea7e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:48Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(601331e0-d051-4a95-9d44-b12ed039d82b),volume_type_id=601331e0-d051-4a95-9d44-b12ed039d82b)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c2538c-ea3f-435d-a29f-52532759fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c2538c-ea3f-435d-a29f-52532759fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2a355a-c6db-469a-9d48-2748e7b401fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2a355a-c6db-469a-9d48-2748e7b401fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b706af9-89fa-4042-934b-1c508cea7e24', 'volume_name': 'volume-7b706af9-89fa-4042-934b-1c508cea7e24', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc816c7a-a5a2-44ea-bb47-f96236d57108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc816c7a-a5a2-44ea-bb47-f96236d57108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7219667e-cc04-4545-864f-07e6db52a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:48 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Volume 7b706af9-89fa-4042-934b-1c508cea7e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b706af9-89fa-4042-934b-1c508cea7e24', 'volume_size': 1} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:48 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:13:48 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:49 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 0.749s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.792s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=126e9987-5774-48f3-b74d-f45feebeb976,created_at=2026-04-28T14:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324307271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=126e9987-5774-48f3-b74d-f45feebeb976,host='devstack@QuobyteHD#QuobyteHD',id=7b706af9-89fa-4042-934b-1c508cea7e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:48Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(601331e0-d051-4a95-9d44-b12ed039d82b),volume_type_id=601331e0-d051-4a95-9d44-b12ed039d82b)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Creating volume 7b706af9-89fa-4042-934b-1c508cea7e24 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:49 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:49 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 1073741824 Apr 28 16:13:49 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Attempting download of 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume a40f79d6-ea52-48c1-ab15-450596953348. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3a3760-8fb7-48b9-b2b8-89478f8e424b]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:49 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j Apr 28 16:13:49 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:50 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j" returned: 0 in 0.901s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:50 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j Apr 28 16:13:50 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:50 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 1073741824" returned: 0 in 1.158s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:50 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 Apr 28 16:13:50 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Flow 'volume_create_manager' (de9838fe-1572-4a1e-b012-f56d35693104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363f1c8-0f5d-4278-8d07-f1ccac1c5936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363f1c8-0f5d-4278-8d07-f1ccac1c5936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2078525294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52448a3-8ae7-4f66-8491-9fbb6339c747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918bcac49a7e46cbbc0f997edd08b4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:51Z,use_quota=True,user_id='8121dc86571d47cea92dbaf093315370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4237577-faf4-4c69-a87e-04dd13fce96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4237577-faf4-4c69-a87e-04dd13fce96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8220f3-bf94-4d7c-9320-97e55e3aa46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8220f3-bf94-4d7c-9320-97e55e3aa46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52448a3-8ae7-4f66-8491-9fbb6339c747', 'volume_name': 'volume-c52448a3-8ae7-4f66-8491-9fbb6339c747', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525d258-8f82-4a6f-84a4-31e283c9536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3525d258-8f82-4a6f-84a4-31e283c9536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c25abdd-ea21-482e-9f72-269af6055ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:50 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Volume c52448a3-8ae7-4f66-8491-9fbb6339c747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52448a3-8ae7-4f66-8491-9fbb6339c747', 'volume_size': 1} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:51 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j" returned: 1 in 0.967s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_iutfyy1j' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c1dc74-a4e9-4fd4-a52b-d47a82f4fd4b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:51 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24" returned: 0 in 0.817s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2078525294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52448a3-8ae7-4f66-8491-9fbb6339c747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918bcac49a7e46cbbc0f997edd08b4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:51Z,use_quota=True,user_id='8121dc86571d47cea92dbaf093315370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Creating volume c52448a3-8ae7-4f66-8491-9fbb6339c747 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:51 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7219667e-cc04-4545-864f-07e6db52a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b706af9-89fa-4042-934b-1c508cea7e24', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:51 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 1073741824 Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0372c788-b15b-4c73-9495-48dc54b723cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:51 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:51 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Volume volume-7b706af9-89fa-4042-934b-1c508cea7e24 (7b706af9-89fa-4042-934b-1c508cea7e24): created successfully Apr 28 16:13:51 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD Apr 28 16:13:51 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0372c788-b15b-4c73-9495-48dc54b723cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (b047e445-31d0-4a56-b06f-5237115295bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9b9c4a94-88b5-40af-adec-fd00808f8622 tempest-GroupsTest-1386922833 None] Created volume successfully. Apr 28 16:13:52 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] 15a518ba-55ac-48ec-8b87-111778c54a6b was qcow2, converting to raw {{(pid=84171) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:52 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:13:52 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:52 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 1073741824" returned: 0 in 1.073s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Acquiring lock "cinder-quobyte-7b706af9-89fa-4042-934b-1c508cea7e24" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-7b706af9-89fa-4042-934b-1c508cea7e24" acquired by "delete_volume" :: waited 0.064s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:52 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 Apr 28 16:13:52 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1dab19-c232-490e-af46-75b6b8dab8b7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:52 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 Apr 28 16:13:52 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:53 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747" returned: 0 in 0.966s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c25abdd-ea21-482e-9f72-269af6055ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52448a3-8ae7-4f66-8491-9fbb6339c747', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9e867f-08eb-4a7a-b259-5153e0349155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:53 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Volume volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 (c52448a3-8ae7-4f66-8491-9fbb6339c747): created successfully Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9e867f-08eb-4a7a-b259-5153e0349155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Flow 'volume_create_manager' (de9838fe-1572-4a1e-b012-f56d35693104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7597f42a-b156-4a10-ab6e-cf76219deb69 tempest-AbsoluteLimitsTests-1981897560 None] Created volume successfully. Apr 28 16:13:53 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24" returned: 0 in 0.986s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:53 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24 Apr 28 16:13:53 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:54 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7b706af9-89fa-4042-934b-1c508cea7e24" returned: 0 in 0.673s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-7b706af9-89fa-4042-934b-1c508cea7e24" released by "delete_volume" :: held 1.744s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Created reservations ['0fc14c58-5203-40ae-97e1-e36bd08ccccf'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:54 devstack cinder-volume[84171]: WARNING cinder.quota [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-683004781 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-683004781, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:54 devstack cinder-volume[84171]: WARNING cinder.quota [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-683004781 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-683004781, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Created reservations ['c2c3085c-57b0-432a-b946-a09f25ec74b1', '2b5910e7-589f-423c-b882-3eac611894ed', '137dc32b-ec62-4920-b364-a1b938491e15', 'b58ddd56-1090-4b3b-8dd6-5cd4eed19893'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Acquiring lock "cinder-c52448a3-8ae7-4f66-8491-9fbb6339c747-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "cinder-c52448a3-8ae7-4f66-8491-9fbb6339c747-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:54 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 2.473s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_glvcaio3devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:13:54 devstack cinder-volume[84171]: INFO cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Converted 112.00 MB image at 45.26 MB/s Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:54 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:54 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Acquiring lock "cinder-quobyte-c52448a3-8ae7-4f66-8491-9fbb6339c747" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:13:54 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1G Apr 28 16:13:54 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "cinder-quobyte-c52448a3-8ae7-4f66-8491-9fbb6339c747" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dccf9b-2b4d-4cff-84ce-53ddc5b1c338]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:54 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 Apr 28 16:13:54 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:54 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Created reservations ['ecc27cbf-c332-41c5-a15b-4eeb037c079d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:55 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:55 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:55 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.785s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-6198ef8b-be2b-414d-b20d-793748816c84 tempest-GroupsTest-1386922833 None] Delete group completed successfully. Apr 28 16:13:55 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 1G" returned: 0 in 0.949s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e2c8a-0c1b-447d-85bf-7461cc6e319f]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:55 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747" returned: 0 in 1.011s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:55 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747 Apr 28 16:13:55 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:55 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:13:55 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:55 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.945s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:55 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:56 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-71faad83-b685-400c-b034-5710201133b5 tempest-GroupsTest-1386922833 None] Delete group completed successfully. Apr 28 16:13:56 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 1.039s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:56 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c52448a3-8ae7-4f66-8491-9fbb6339c747" returned: 0 in 0.962s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "cinder-quobyte-c52448a3-8ae7-4f66-8491-9fbb6339c747" released by "delete_volume" :: held 2.043s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Created reservations ['7371f2e9-dd81-4c71-9a12-e082ded31988', '23ab20ee-1f9a-4acb-aeec-2bc26dda4f2f', '16843757-5f4f-4f41-8065-80f95f918149', '1a9bd2b9-546c-446a-ad1c-bcb4128e4df9'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:13:56 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:13:56 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:56 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:13:56 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c8fa99b0-24ec-4508-9b46-86f9dcbcfcae tempest-GroupsTest-1386922833 None] Group tempest-GroupsTest-Group-1183543494: creating Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c8fa99b0-24ec-4508-9b46-86f9dcbcfcae tempest-GroupsTest-1386922833 None] Group tempest-GroupsTest-Group-1183543494: created successfully Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c8fa99b0-24ec-4508-9b46-86f9dcbcfcae tempest-GroupsTest-1386922833 None] Create group completed successfully. Apr 28 16:13:57 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 1 in 0.852s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Downloaded image 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume a40f79d6-ea52-48c1-ab15-450596953348 successfully. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b for user e962846d36db4d3cb3362b1aa0c1ab09 is deleted. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Marking volume a40f79d6-ea52-48c1-ab15-450596953348 as bootable. {{(pid=84171) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Copying metadata from image 15a518ba-55ac-48ec-8b87-111778c54a6b to a40f79d6-ea52-48c1-ab15-450596953348. {{(pid=84171) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Creating volume glance metadata for volume a40f79d6-ea52-48c1-ab15-450596953348 backed by image 15a518ba-55ac-48ec-8b87-111778c54a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84171) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0221e5-7fef-4150-b1b2-66014b3694e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a40f79d6-ea52-48c1-ab15-450596953348', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616a17d-9f14-4ffa-9612-4951c449091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Volume volume-a40f79d6-ea52-48c1-ab15-450596953348 (a40f79d6-ea52-48c1-ab15-450596953348): created successfully Apr 28 16:13:57 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1616a17d-9f14-4ffa-9612-4951c449091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Flow 'volume_create_manager' (a914c0a6-b57b-41a6-812a-a34a8c0fb2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.768s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Deleted volume successfully. Apr 28 16:13:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-0351b7c7-f69f-4748-b5e7-aba099b847dd tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Created volume successfully. Apr 28 16:13:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c01de739-5a51-4423-b75f-b0d963025a83 tempest-AbsoluteLimitsTests-1981897560 None] Lock "cinder-c52448a3-8ae7-4f66-8491-9fbb6339c747-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (3606d2c2-6b8e-4f5f-b25d-e93c5473552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809f74e-f0c6-42b1-b673-64eb8b395bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809f74e-f0c6-42b1-b673-64eb8b395bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525605382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d94276f2-37bb-4757-a609-e74cde8850ee,host='devstack@QuobyteHD#QuobyteHD',id=49f1f1f3-fa05-44f2-9b2b-6cc031b8c429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:59Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3),volume_type_id=9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c58f82-b880-4f23-a7fe-343fb68ede33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c58f82-b880-4f23-a7fe-343fb68ede33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e038dd15-42aa-470a-8946-431b7286455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e038dd15-42aa-470a-8946-431b7286455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f1f1f3-fa05-44f2-9b2b-6cc031b8c429', 'volume_name': 'volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39270e04-f377-4fb7-9605-4a1b33234800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39270e04-f377-4fb7-9605-4a1b33234800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418f7189-fc1a-403e-b959-7ffc74316cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:13:58 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Volume 49f1f1f3-fa05-44f2-9b2b-6cc031b8c429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429', 'volume_size': 1} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d94276f2-37bb-4757-a609-e74cde8850ee,created_at=2026-04-28T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525605382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d94276f2-37bb-4757-a609-e74cde8850ee,host='devstack@QuobyteHD#QuobyteHD',id=49f1f1f3-fa05-44f2-9b2b-6cc031b8c429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:13:59Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3),volume_type_id=9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Creating volume 49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:13:58 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:13:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:13:58 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 1073741824 Apr 28 16:13:58 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:13:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:00 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 1073741824" returned: 0 in 1.136s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:00 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 Apr 28 16:14:00 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:00 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:00 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:00 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" returned: 0 in 0.878s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.384s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418f7189-fc1a-403e-b959-7ffc74316cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8853544-b4d2-4ee0-8222-f00f6a5c9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:01 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Volume volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 (49f1f1f3-fa05-44f2-9b2b-6cc031b8c429): created successfully Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8853544-b4d2-4ee0-8222-f00f6a5c9edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (3606d2c2-6b8e-4f5f-b25d-e93c5473552c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541de8f-f38d-4ce9-81af-c130d7766b7f]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-14c4b73b-5a67-4748-a048-9374c5ad3a24 tempest-GroupsTest-1386922833 None] Created volume successfully. Apr 28 16:14:01 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:14:01 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:01 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.998s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:02 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 0.991s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:02 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:14:02 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (5cb3dac8-6dd6-4c43-9d26-e6d3996cf165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f41038a-5b2b-4efd-84c8-36571aae3653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f41038a-5b2b-4efd-84c8-36571aae3653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-757876619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d94276f2-37bb-4757-a609-e74cde8850ee,host='devstack@QuobyteHD#QuobyteHD',id=5fc9cb25-de16-450d-bf46-e698b37579be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:03Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3),volume_type_id=9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba78e21-f11e-49d7-b9c4-1ef8b808472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba78e21-f11e-49d7-b9c4-1ef8b808472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44220dd-6171-453f-814b-4200e58a0a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44220dd-6171-453f-814b-4200e58a0a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc9cb25-de16-450d-bf46-e698b37579be', 'volume_name': 'volume-5fc9cb25-de16-450d-bf46-e698b37579be', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f7c5db-2707-46b5-af60-745aacda1381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f7c5db-2707-46b5-af60-745aacda1381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db3440f-4314-444d-893c-476c80db6fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:03 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Volume 5fc9cb25-de16-450d-bf46-e698b37579be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc9cb25-de16-450d-bf46-e698b37579be', 'volume_size': 1} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:03 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 1 in 1.328s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.411s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d94276f2-37bb-4757-a609-e74cde8850ee,created_at=2026-04-28T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-757876619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d94276f2-37bb-4757-a609-e74cde8850ee,host='devstack@QuobyteHD#QuobyteHD',id=5fc9cb25-de16-450d-bf46-e698b37579be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44fdded952ae4ef68a55849c88f6279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:03Z,use_quota=True,user_id='1e9c582844504180ba3ff794af9378ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3),volume_type_id=9d8a0c9c-19d6-41ff-976c-f9d28d1cf3c3)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Creating volume 5fc9cb25-de16-450d-bf46-e698b37579be {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:14:03 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:03 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be 1073741824 Apr 28 16:14:03 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207', 'name': 'volume-a40f79d6-ea52-48c1-ab15-450596953348', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '798f6537-7cb7-40a1-b4a9-2cea4946526a', 'enforce_multipath': True} {{(pid=84171) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 16:14:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-086438b3-ca15-4e45-9b2f-22a3ac78ec7e req-53a2ff58-49f8-4091-9572-937df69141bf tempest-ServerBootFromVolumeStableRescueTest-605669582 None] attachment_update completed successfully. Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (b0c6b884-158e-4530-8803-24f209fd3be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669d0ee9-012f-460c-a986-35e471da2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669d0ee9-012f-460c-a986-35e471da2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-679123625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce36a782-b8da-4147-bc2b-aa6504b4e9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a72794fb40417895ddb7d5179da718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:04Z,use_quota=True,user_id='2290b35da3834c85af6de0e1815134da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a6483b-5f27-49c9-bc5c-58a478d9b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a6483b-5f27-49c9-bc5c-58a478d9b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892638ec-f63e-4283-976a-fbd7753ed143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892638ec-f63e-4283-976a-fbd7753ed143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce36a782-b8da-4147-bc2b-aa6504b4e9d6', 'volume_name': 'volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d33f424-8d32-4507-bec6-fea871114e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d33f424-8d32-4507-bec6-fea871114e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c939fc-293f-45f5-b563-b9ac6b0410f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:04 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6', 'volume_size': 1} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:04 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be 1073741824" returned: 0 in 1.171s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:04 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be Apr 28 16:14:04 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:05 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be" returned: 0 in 0.803s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-679123625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce36a782-b8da-4147-bc2b-aa6504b4e9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a72794fb40417895ddb7d5179da718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:04Z,use_quota=True,user_id='2290b35da3834c85af6de0e1815134da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Creating volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:14:05 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db3440f-4314-444d-893c-476c80db6fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc9cb25-de16-450d-bf46-e698b37579be', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:05 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 1073741824 Apr 28 16:14:05 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1477c8f7-ad41-4bd4-bbf5-72f8a1e0ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:05 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Volume volume-5fc9cb25-de16-450d-bf46-e698b37579be (5fc9cb25-de16-450d-bf46-e698b37579be): created successfully Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1477c8f7-ad41-4bd4-bbf5-72f8a1e0ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Flow 'volume_create_manager' (5cb3dac8-6dd6-4c43-9d26-e6d3996cf165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:05 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d39a94bd-690a-4eef-ac66-52c3979edc32 tempest-GroupsTest-1386922833 None] Created volume successfully. Apr 28 16:14:06 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 1073741824" returned: 0 in 1.281s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:06 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 Apr 28 16:14:06 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-53a32699-1ac6-44a8-acea-5b4ecf47c5ce tempest-GroupsTest-1386922833 None] Update group completed successfully. Apr 28 16:14:07 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c939fc-293f-45f5-b563-b9ac6b0410f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6979b-d63b-4363-9a4e-b6849e988271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Volume volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 (ce36a782-b8da-4147-bc2b-aa6504b4e9d6): created successfully Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89f6979b-d63b-4363-9a4e-b6849e988271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (b0c6b884-158e-4530-8803-24f209fd3be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c0240dcc-f532-4817-8d79-246a7ef6c2af tempest-VolumesDeleteCascade-1592968505 None] Created volume successfully. Apr 28 16:14:08 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-43c4bf72-f9b8-47d6-8305-726eb7e1f5a7 tempest-GroupsTest-1386922833 None] Update group completed successfully. Apr 28 16:14:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Creating offline snapshot b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 of volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:14:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4639dd3f-66bf-45cc-a0e9-f9f1dec09e08]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:08 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 Apr 28 16:14:08 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:09 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" returned: 0 in 0.903s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:09 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 1G Apr 28 16:14:09 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Acquiring lock "cinder-quobyte-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d00932-07c7-495c-a4e8-09683e2c0565]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:10 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 Apr 28 16:14:10 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:10 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 1G" returned: 0 in 0.995s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:10 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:10 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:10 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" returned: 0 in 0.904s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:10 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429 Apr 28 16:14:10 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:11 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.673s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:11 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 is being set with open permissions: ugo+rw Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:11 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:11 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:11 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-49f1f1f3-fa05-44f2-9b2b-6cc031b8c429" released by "delete_volume" :: held 1.663s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Acquiring lock "cinder-quobyte-5fc9cb25-de16-450d-bf46-e698b37579be" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-5fc9cb25-de16-450d-bf46-e698b37579be" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa9f42-082d-475c-b9a5-72cb8d2408d8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:11 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be Apr 28 16:14:11 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:12 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.713s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:12 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info Apr 28 16:14:12 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:12 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be" returned: 0 in 0.823s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:12 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be Apr 28 16:14:12 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:12 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info" returned: 0 in 0.699s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:12 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info is being set with open permissions: ugo+rw Apr 28 16:14:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:12 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info Apr 28 16:14:12 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:13 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5fc9cb25-de16-450d-bf46-e698b37579be" returned: 0 in 0.637s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "cinder-quobyte-5fc9cb25-de16-450d-bf46-e698b37579be" released by "delete_volume" :: held 1.520s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Created reservations ['e8174a53-9088-494a-afc9-b46c1fbc19b4'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:13 devstack cinder-volume[84171]: WARNING cinder.quota [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1199121190 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1199121190, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:14:13 devstack cinder-volume[84171]: WARNING cinder.quota [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1199121190 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1199121190, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Created reservations ['9ecfeb16-bef1-4c79-bdcf-bb85da9eb2a5', '57ab5242-2d59-49ad-ac6f-fe4af825e48c', '78048d5e-c4b5-40b8-b74e-c4b259cddc84', 'c9e2ef5f-7fb1-4ee0-9b60-500d2f57f3f6'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Created reservations ['f348c755-46d0-4eab-bacf-4b0d1ac0a299', '91b27507-294e-43a2-ac4d-a11242c7bdff', '7b5eae36-3ecb-4931-8da5-11ad3c41580c', '837f5eab-4910-42b3-8419-853a04f70bf6'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:13 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.info" returned: 0 in 0.731s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.820s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:13 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:13 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:13 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3c4f1881-aafc-48e3-b5b6-1015d7a7d164 tempest-VolumesDeleteCascade-1592968505 None] Create snapshot completed successfully Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Creating offline snapshot 3a9a16e3-d129-43c4-8eb1-144ee7afc701 of volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057c7d6-7601-4d6e-9d12-378947e6a193]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:14 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.653s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:14 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b2f80c6a-5638-4362-a1f5-2e1da0d396c9 tempest-GroupsTest-1386922833 None] Delete group completed successfully. Apr 28 16:14:14 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:14 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:14 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.802s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:15 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 1G Apr 28 16:14:15 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:15 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 1G" returned: 0 in 1.000s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:16 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 Apr 28 16:14:16 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:17 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701" returned: 0 in 1.459s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:17 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 is being set with open permissions: ugo+rw Apr 28 16:14:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:17 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 Apr 28 16:14:17 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:18 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701" returned: 0 in 1.301s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.707s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-44327766-07ee-45de-a73a-5431d8ee42c4 tempest-VolumesDeleteCascade-1592968505 None] Create snapshot completed successfully Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-ce36a782-b8da-4147-bc2b-aa6504b4e9d6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-ce36a782-b8da-4147-bc2b-aa6504b4e9d6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Performing cascade delete. {{(pid=84171) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-3a9a16e3-d129-43c4-8eb1-144ee7afc701-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-3a9a16e3-d129-43c4-8eb1-144ee7afc701-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-3a9a16e3-d129-43c4-8eb1-144ee7afc701" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-3a9a16e3-d129-43c4-8eb1-144ee7afc701" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Deleting offline snapshot 3a9a16e3-d129-43c4-8eb1-144ee7afc701 of volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:14:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] snapshot_file for this snap is: volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:14:20 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[05081494-c90c-406f-85e7-ddc3a9bc06a5]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:20 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 Apr 28 16:14:20 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:21 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701" returned: 0 in 1.266s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b240f-396b-4349-a3e6-20a205b98c0d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:21 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:21 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:22 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.981s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:22 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 Apr 28 16:14:22 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:23 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701" returned: 0 in 0.913s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:23 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701 Apr 28 16:14:23 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8faf4855-89fa-47cd-9949-ae211c89f0df tempest-GroupsV314Test-867366836 None] Group tempest-GroupsV314Test-Group-1340376922: creating Apr 28 16:14:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8faf4855-89fa-47cd-9949-ae211c89f0df tempest-GroupsV314Test-867366836 None] Group tempest-GroupsV314Test-Group-1340376922: created successfully Apr 28 16:14:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8faf4855-89fa-47cd-9949-ae211c89f0df tempest-GroupsV314Test-867366836 None] Create group completed successfully. Apr 28 16:14:24 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.3a9a16e3-d129-43c4-8eb1-144ee7afc701" returned: 0 in 0.830s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-3a9a16e3-d129-43c4-8eb1-144ee7afc701" released by "_delete_snapshot" :: held 4.123s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" released by "delete_snapshot" :: held 4.148s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['8435817b-b3ee-4a63-b834-46268bf8454c', 'd5089831-8adc-4b43-8aa7-8844e9828743', '030b1d99-dde6-4015-9ebd-9577e5e4af1f', '40d0d542-9848-4477-a704-2dac8e4295f1'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Delete snapshot completed successfully. Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-3a9a16e3-d129-43c4-8eb1-144ee7afc701-delete_snapshot" released by "delete_snapshot" :: held 4.325s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Deleting offline snapshot b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 of volume ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] snapshot_file for this snap is: volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a6e92-8fa2-4c4e-aa0b-2c3d03f4f6c8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:24 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:24 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:24 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Flow 'volume_create_manager' (7de134e7-7fcb-4359-9621-02088c049d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af4999a-b9a9-45fc-a4e8-cbf99b0d9512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af4999a-b9a9-45fc-a4e8-cbf99b0d9512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610624237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ebd1e8b-0f84-4b82-b590-a2436073d067,host='devstack@QuobyteHD#QuobyteHD',id=cac29487-bf09-43aa-965d-28547ec6b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25d82687c974621a03d95d99188311d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:25Z,use_quota=True,user_id='cb910181657d4266b306dde43a59d68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ae71f3a-996b-4f6e-9e62-445678e1e830),volume_type_id=8ae71f3a-996b-4f6e-9e62-445678e1e830)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8438a52-832f-4f95-832d-14f6e688b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8438a52-832f-4f95-832d-14f6e688b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a712f1a9-3aa0-41ee-a25b-5150d79a3f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a712f1a9-3aa0-41ee-a25b-5150d79a3f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac29487-bf09-43aa-965d-28547ec6b079', 'volume_name': 'volume-cac29487-bf09-43aa-965d-28547ec6b079', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e24b45c-8910-45c2-9f5f-3e253470e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e24b45c-8910-45c2-9f5f-3e253470e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b4224-3990-4256-bfb9-ae0305d36828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Volume cac29487-bf09-43aa-965d-28547ec6b079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac29487-bf09-43aa-965d-28547ec6b079', 'volume_size': 1} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ebd1e8b-0f84-4b82-b590-a2436073d067,created_at=2026-04-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610624237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ebd1e8b-0f84-4b82-b590-a2436073d067,host='devstack@QuobyteHD#QuobyteHD',id=cac29487-bf09-43aa-965d-28547ec6b079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25d82687c974621a03d95d99188311d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:25Z,use_quota=True,user_id='cb910181657d4266b306dde43a59d68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ae71f3a-996b-4f6e-9e62-445678e1e830),volume_type_id=8ae71f3a-996b-4f6e-9e62-445678e1e830)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Creating volume cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:14:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:25 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 1073741824 Apr 28 16:14:25 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:25 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.833s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ce4f0a-bb76-45a8-b0a7-a02f8fad3f99]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:25 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 Apr 28 16:14:25 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:26 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 1073741824" returned: 0 in 1.167s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:26 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:26 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:26 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" returned: 0 in 1.306s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:26 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:26 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:27 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 1.117s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148b4224-3990-4256-bfb9-ae0305d36828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac29487-bf09-43aa-965d-28547ec6b079', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ca0d90-cd7c-4622-a8a6-a766357ee894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Volume volume-cac29487-bf09-43aa-965d-28547ec6b079 (cac29487-bf09-43aa-965d-28547ec6b079): created successfully Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ca0d90-cd7c-4622-a8a6-a766357ee894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Flow 'volume_create_manager' (7de134e7-7fcb-4359-9621-02088c049d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0c828ebb-530d-4de2-9eb4-c8dcd832fa14 tempest-GroupsV314Test-867366836 None] Created volume successfully. Apr 28 16:14:27 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 1.241s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:27 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8 Apr 28 16:14:27 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:28 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6.b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" returned: 0 in 0.665s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8" released by "_delete_snapshot" :: held 4.221s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" released by "delete_snapshot" :: held 4.245s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['cd4f38d1-0c63-4008-b30c-d2582640e55a', 'aa9ac1d4-0597-405e-8902-b355e4dde3ef', 'cf5a74fd-1ec3-4ce5-b406-df921a7b3825', '3204c91e-3121-441f-93a6-447d147d0f9d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=103,cinder:SELECT=99,cinder:INSERT=33,cinder:DELETE=8 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=115,cinder:INSERT=36,cinder:UPDATE=97,cinder:DELETE=4 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:14:28 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Delete snapshot completed successfully. Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-b9ab0c56-93a4-4a4e-8567-fc031f23fbe8-delete_snapshot" released by "delete_snapshot" :: held 4.481s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Snapshots deleted, issuing volume delete {{(pid=84171) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca45e1d-3bd1-4560-b14b-d743fde32cf3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:29 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 Apr 28 16:14:29 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:29 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Cloning volume cac29487-bf09-43aa-965d-28547ec6b079 to volume f8c80a68-4a66-481d-b278-26c14e792b61 Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Creating offline snapshot c5245925-e088-4f4b-9bf1-a99642b65501 of volume cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:14:29 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" returned: 0 in 0.998s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36fd1f-ea34-469e-83eb-177884b21064]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:29 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6 Apr 28 16:14:29 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:30 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:30 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:30 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" returned: 0 in 0.893s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-ce36a782-b8da-4147-bc2b-aa6504b4e9d6" released by "delete_volume" :: held 2.053s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:30 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['79f84251-9006-462e-acec-494ade698339', '0069205d-bbb1-4fae-9251-03fe15dac5b2', '16ee4bec-5d03-4a9d-9279-9c8ffec0951a', '7238820d-5d2b-4567-857f-d6fc3add2b1d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:30 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 1.075s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:14:31 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 1G Apr 28 16:14:31 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (661aa678-2392-4251-af8e-3626017d9435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20da4ac2-ecaa-43a5-8161-76d9a9d2f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20da4ac2-ecaa-43a5-8161-76d9a9d2f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252315529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb97163-1967-483b-b714-84e00f235f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:31Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cbbecf-4c4e-4c33-91ab-52c8743712d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08cbbecf-4c4e-4c33-91ab-52c8743712d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81e5190-8ae1-40f2-ad6f-a068340b509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81e5190-8ae1-40f2-ad6f-a068340b509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb97163-1967-483b-b714-84e00f235f6b', 'volume_name': 'volume-0cb97163-1967-483b-b714-84e00f235f6b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f79b85c-28c1-478e-ae10-fe8adc9c9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f79b85c-28c1-478e-ae10-fe8adc9c9929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc9bf84-b1e8-46e2-8483-709d78273957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:31 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Volume 0cb97163-1967-483b-b714-84e00f235f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb97163-1967-483b-b714-84e00f235f6b', 'volume_size': 1} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:31 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:31 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:32 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.134s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:32 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:32 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 1G" returned: 0 in 1.301s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac29487-bf09-43aa-965d-28547ec6b079 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:32 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Deleted volume successfully. Apr 28 16:14:32 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac29487-bf09-43aa-965d-28547ec6b079 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:32 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4748c5c2-037e-4fba-9d4c-7f00b1e0af15 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-ce36a782-b8da-4147-bc2b-aa6504b4e9d6-delete_volume" released by "delete_volume" :: held 12.689s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (4db45e75-7151-4a84-929d-ec77ad440623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de097904-7225-4867-9c59-b29f16279c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de097904-7225-4867-9c59-b29f16279c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1708624684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c7710-aa7f-4189-9b20-0e2b834c3382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a72794fb40417895ddb7d5179da718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:33Z,use_quota=True,user_id='2290b35da3834c85af6de0e1815134da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d587e-74bb-45bc-a088-2a05b0b2ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120d587e-74bb-45bc-a088-2a05b0b2ea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4b4e98-24e6-48d9-8b79-db8474286eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4b4e98-24e6-48d9-8b79-db8474286eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503c7710-aa7f-4189-9b20-0e2b834c3382', 'volume_name': 'volume-503c7710-aa7f-4189-9b20-0e2b834c3382', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360341f2-a5ac-402a-bb9a-734249750b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360341f2-a5ac-402a-bb9a-734249750b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c3627-558f-4b6c-8657-8377e0c4e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:33 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Volume 503c7710-aa7f-4189-9b20-0e2b834c3382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503c7710-aa7f-4189-9b20-0e2b834c3382', 'volume_size': 1} Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:33 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac29487-bf09-43aa-965d-28547ec6b079 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 1.346s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:14:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:33 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:33 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:34 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 0.715s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:34 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info Apr 28 16:14:34 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:35 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info" returned: 0 in 0.873s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:35 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:14:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:35 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info Apr 28 16:14:35 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:36 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.info" returned: 0 in 0.780s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Acquiring lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] snapshot: c5245925-e088-4f4b-9bf1-a99642b65501, volume: f8c80a68-4a66-481d-b278-26c14e792b61, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[86269568-3f04-4277-b447-eb7bdd68266a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:36 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:36 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:36 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 0.832s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac29487-bf09-43aa-965d-28547ec6b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e64bc-3add-4bfb-b8ea-239e2806e6c2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:37 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:37 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:37 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:14:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:37 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 Apr 28 16:14:37 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:44 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=15,cinder:SELECT=13,cinder:INSERT=2 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:14:44 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:14:45 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61" returned: 0 in 7.544s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8411a1b-20fd-4090-aa47-fe4b70ad7f42]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:45 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:45 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:46 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 0.876s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:46 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:14:46 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Converted 1024.00 MB image at 135.72 MB/s Apr 28 16:14:46 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 16:14:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:46 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 Apr 28 16:14:46 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:47 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61" returned: 0 in 0.654s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" released by "_copy_volume_from_snapshot" :: held 10.945s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Acquiring lock "cinder-quobyte-c5245925-e088-4f4b-9bf1-a99642b65501" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-c5245925-e088-4f4b-9bf1-a99642b65501" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Deleting offline snapshot c5245925-e088-4f4b-9bf1-a99642b65501 of volume cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] snapshot_file for this snap is: volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b0087-a85c-4e61-a9c6-08111840d879]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:47 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:47 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:47 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-286d9979-0c66-401b-9317-d04905f9a2af req-d737d861-78ab-4b9f-8540-9c3d40134169 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Terminate volume connection completed successfully. Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-286d9979-0c66-401b-9317-d04905f9a2af req-d737d861-78ab-4b9f-8540-9c3d40134169 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Deleting attachment 798f6537-7cb7-40a1-b4a9-2cea4946526a. {{(pid=84171) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 16:14:47 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac29487-bf09-43aa-965d-28547ec6b079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0a699-7d7e-455a-b42c-42ed0af6cbd2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:48 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:48 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "cinder-a40f79d6-ea52-48c1-ab15-450596953348-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-a40f79d6-ea52-48c1-ab15-450596953348-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "cinder-quobyte-a40f79d6-ea52-48c1-ab15-450596953348" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-quobyte-a40f79d6-ea52-48c1-ab15-450596953348" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcffbab3-5671-4da8-95bd-d6271f43959b]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:48 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:14:48 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:48 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 0.816s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:48 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:48 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:49 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 0.794s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:49 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:14:49 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:49 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 0.838s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:49 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501 Apr 28 16:14:49 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:49 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 1 in 0.702s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:14:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:49 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348 Apr 28 16:14:49 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:50 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079.c5245925-e088-4f4b-9bf1-a99642b65501" returned: 0 in 0.603s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-c5245925-e088-4f4b-9bf1-a99642b65501" released by "_delete_snapshot" :: held 3.108s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.412s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.117s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252315529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb97163-1967-483b-b714-84e00f235f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:31Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Creating volume 0cb97163-1967-483b-b714-84e00f235f6b {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:14:50 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:50 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b 1073741824 Apr 28 16:14:50 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:50 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2288d53a-e717-4f23-9ec3-12ffa469cfdb tempest-GroupsV314Test-867366836 None] Create group from source-group-0ebd1e8b-0f84-4b82-b590-a2436073d067 completed successfully. Apr 28 16:14:50 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a40f79d6-ea52-48c1-ab15-450596953348" returned: 0 in 0.654s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-quobyte-a40f79d6-ea52-48c1-ab15-450596953348" released by "delete_volume" :: held 2.253s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.quota [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Created reservations ['ec09951f-673f-4f58-bb70-197bde14b7cc', '3ae178e4-59f5-431e-b0ad-3432e99d73cb', 'ed4baf0f-cc98-411b-8709-5398b212dcb4', '9a0c64b8-11ec-4814-96bb-a07f81aeca82'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:50 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:50 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Acquiring lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" acquired by "delete_volume" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3420c555-0c1d-45ef-be15-73c28e1645d8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:51 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 Apr 28 16:14:51 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:51 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b 1073741824" returned: 0 in 0.931s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:51 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b Apr 28 16:14:51 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:51 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.690s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.manager [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Deleted volume successfully. Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-286d9979-0c66-401b-9317-d04905f9a2af req-d55bca63-4486-4041-8ecb-99912de29b63 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-a40f79d6-ea52-48c1-ab15-450596953348-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:51 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61" returned: 0 in 0.802s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:51 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61 Apr 28 16:14:51 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:51 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b" returned: 0 in 0.697s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.447s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1708624684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c7710-aa7f-4189-9b20-0e2b834c3382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a72794fb40417895ddb7d5179da718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:14:33Z,use_quota=True,user_id='2290b35da3834c85af6de0e1815134da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Creating volume 503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:14:51 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc9bf84-b1e8-46e2-8483-709d78273957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb97163-1967-483b-b714-84e00f235f6b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:51 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 1073741824 Apr 28 16:14:51 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97784fc-a242-4b15-bc40-7f6cb99daab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:51 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Volume volume-0cb97163-1967-483b-b714-84e00f235f6b (0cb97163-1967-483b-b714-84e00f235f6b): created successfully Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97784fc-a242-4b15-bc40-7f6cb99daab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (661aa678-2392-4251-af8e-3626017d9435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:52 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-503ddd84-7391-430a-9909-b0dd67762a7a tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:14:52 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f8c80a68-4a66-481d-b278-26c14e792b61" returned: 0 in 0.785s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-f8c80a68-4a66-481d-b278-26c14e792b61" released by "delete_volume" :: held 1.637s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Created reservations ['887363e5-dbd2-4df1-af1b-a0c2343b59a4'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:52 devstack cinder-volume[84171]: WARNING cinder.quota [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1636721629 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1636721629, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:14:52 devstack cinder-volume[84171]: WARNING cinder.quota [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1636721629 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1636721629, it is now deprecated. Please use the default quota class for default quota. Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Created reservations ['6e2a6b6d-19a0-403e-ac97-7d941948ea43', 'bce0e445-d38a-405a-8840-cd526cd1ba83', 'd83efc28-c781-4019-b5d1-229d6eedbc03', '45d8af67-c1dc-499c-8175-0c7b959504cf'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-75ed601e-3a10-4654-84dd-d1df1122f990 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b" by "attach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-75ed601e-3a10-4654-84dd-d1df1122f990 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b" acquired by "attach_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:52 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-75ed601e-3a10-4654-84dd-d1df1122f990 tempest-VolumesActionsTest-771568387 None] Attaching volume 0cb97163-1967-483b-b714-84e00f235f6b to instance 53835402-268c-4a34-afe9-23daf8481584 at mountpoint /dev/vdb on host None. Apr 28 16:14:52 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-75ed601e-3a10-4654-84dd-d1df1122f990 tempest-VolumesActionsTest-771568387 None] Attach volume completed successfully. Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-75ed601e-3a10-4654-84dd-d1df1122f990 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b" released by "attach_volume" :: held 0.148s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:52 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:52 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:52 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 1073741824" returned: 0 in 0.979s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:52 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:14:52 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Acquiring lock "cinder-quobyte-cac29487-bf09-43aa-965d-28547ec6b079" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-cac29487-bf09-43aa-965d-28547ec6b079" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e189a4-24ad-49c6-b018-81db73c97c76]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:53 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.060s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a0662e5e-7626-4865-a2b2-39ce61920f44 tempest-GroupsV314Test-867366836 None] Delete group completed successfully. Apr 28 16:14:54 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:54 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:54 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 1.127s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64c3627-558f-4b6c-8657-8377e0c4e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503c7710-aa7f-4189-9b20-0e2b834c3382', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1463b2fc-63d2-4a1d-a26b-de9eda2667ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:14:54 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Volume volume-503c7710-aa7f-4189-9b20-0e2b834c3382 (503c7710-aa7f-4189-9b20-0e2b834c3382): created successfully Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1463b2fc-63d2-4a1d-a26b-de9eda2667ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (4db45e75-7151-4a84-929d-ec77ad440623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:14:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-310d6aa4-3c24-47ad-b681-2533d1d680cb tempest-VolumesDeleteCascade-1592968505 None] Created volume successfully. Apr 28 16:14:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Terminate volume connection completed successfully. Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" by "detach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:54 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 0.944s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:54 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079 Apr 28 16:14:54 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Detaching volume 0cb97163-1967-483b-b714-84e00f235f6b from instance 53835402-268c-4a34-afe9-23daf8481584. Apr 28 16:14:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Detach volume completed successfully. Apr 28 16:14:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-41c8acdf-dc9c-499e-89cb-f0f783ba5df5 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Creating offline snapshot 99c37a2a-14b9-4d63-ae14-70496df5b2ff of volume 503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9cece4-de1e-4639-9536-e0f631b29d38]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-24297c90-9859-4537-b266-9e9d39b2bf63 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" by "detach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:55 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:14:55 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-24297c90-9859-4537-b266-9e9d39b2bf63 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-24297c90-9859-4537-b266-9e9d39b2bf63 tempest-VolumesActionsTest-771568387 None] Volume detach called, but volume not attached. Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-24297c90-9859-4537-b266-9e9d39b2bf63 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-detach_volume" released by "detach_volume" :: held 0.017s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:55 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cac29487-bf09-43aa-965d-28547ec6b079" returned: 0 in 0.780s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Lock "cinder-quobyte-cac29487-bf09-43aa-965d-28547ec6b079" released by "delete_volume" :: held 1.827s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Created reservations ['6c5036fc-d9f3-41f9-8edb-0d861b326919'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Created reservations ['edd0ffab-b33b-4f47-890d-16eab02ebc9d', '3eb3f4a9-f64f-4b40-9e13-d71d82481b8e', '3e86c4bd-82ed-410c-a8c8-ac8a222c61ca', '627626ea-0e0f-4767-a196-11cd86c4da63'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:55 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:55 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:56 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.797s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:56 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff 1G Apr 28 16:14:56 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-quobyte-0cb97163-1967-483b-b714-84e00f235f6b" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "cinder-quobyte-0cb97163-1967-483b-b714-84e00f235f6b" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d28aa35-cb09-4a26-a167-c7ca7608e86b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:56 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b Apr 28 16:14:56 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:56 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.755s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:56 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:56 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cdde536c-c6a1-4298-ab95-2cc7480376bc tempest-GroupsV314Test-867366836 None] Delete group completed successfully. Apr 28 16:14:57 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff 1G" returned: 0 in 1.051s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503c7710-aa7f-4189-9b20-0e2b834c3382 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:57 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503c7710-aa7f-4189-9b20-0e2b834c3382 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:14:57 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:57 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b" returned: 0 in 0.868s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:57 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b Apr 28 16:14:57 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:57 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-503c7710-aa7f-4189-9b20-0e2b834c3382 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.765s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:57 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff is being set with open permissions: ugo+rw Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:57 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:14:57 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:57 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0cb97163-1967-483b-b714-84e00f235f6b" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "cinder-quobyte-0cb97163-1967-483b-b714-84e00f235f6b" released by "delete_volume" :: held 1.679s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Created reservations ['6ae3aab0-ed46-40b9-82c5-1776ac400f18', 'af8d6237-318f-4e67-bfca-af060d91a628', 'dfb18f04-25f2-469a-9bfe-f2424057c11f', 'e1844c90-3205-4103-a527-30e63393aea5'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:58 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:14:58 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:58 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.727s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:58 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info Apr 28 16:14:58 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:14:59 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.005s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:59 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:14:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Deleted volume successfully. Apr 28 16:14:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-289bad48-1724-46eb-8874-bd634a620230 tempest-VolumesActionsTest-771568387 None] Lock "cinder-0cb97163-1967-483b-b714-84e00f235f6b-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:14:59 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 28 16:14:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info" returned: 0 in 0.818s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:14:59 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info is being set with open permissions: ugo+rw Apr 28 16:14:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:14:59 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info Apr 28 16:14:59 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:00 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.info" returned: 0 in 1.006s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.316s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:00 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-51a237b8-958b-4558-8c37-723a6dfcfd35 tempest-VolumesDeleteCascade-1592968505 None] Create snapshot completed successfully Apr 28 16:15:00 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:00 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:01 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.937s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (384b77a1-2f01-42da-945c-f3bafac99b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae143a-199d-4e26-a5b5-8ab7eb727457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ae143a-199d-4e26-a5b5-8ab7eb727457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1980285939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e71fec1-335a-47ba-944c-ccefbad302a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a72794fb40417895ddb7d5179da718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99c37a2a-14b9-4d63-ae14-70496df5b2ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:02Z,use_quota=True,user_id='2290b35da3834c85af6de0e1815134da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3928764-28ea-4452-8f7f-bed2584a462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3928764-28ea-4452-8f7f-bed2584a462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0bd75-190e-48dc-aa00-90a2aa23b08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e0bd75-190e-48dc-aa00-90a2aa23b08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e71fec1-335a-47ba-944c-ccefbad302a9', 'volume_name': 'volume-5e71fec1-335a-47ba-944c-ccefbad302a9', 'volume_size': 1, 'snapshot_id': '99c37a2a-14b9-4d63-ae14-70496df5b2ff'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611a271c-f15e-4864-9195-6a9aa497b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611a271c-f15e-4864-9195-6a9aa497b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a7182c-b93e-4cf0-bab6-9effe5d082bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:02 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Volume 5e71fec1-335a-47ba-944c-ccefbad302a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e71fec1-335a-47ba-944c-ccefbad302a9', 'volume_size': 1, 'snapshot_id': '99c37a2a-14b9-4d63-ae14-70496df5b2ff'} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff-5e71fec1-335a-47ba-944c-ccefbad302a9" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff-5e71fec1-335a-47ba-944c-ccefbad302a9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Creating volume 5e71fec1-335a-47ba-944c-ccefbad302a9 from snapshot 99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] snapshot: 99c37a2a-14b9-4d63-ae14-70496df5b2ff, volume: 5e71fec1-335a-47ba-944c-ccefbad302a9, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0107b4d2-040c-4944-9f63-189958384332]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:02 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:15:02 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Flow 'volume_create_manager' (eec0dbac-adc5-426e-b164-253530c626d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:03 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7ec9c-c383-47ef-ac04-9cf7697ac8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.803s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503c7710-aa7f-4189-9b20-0e2b834c3382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855c87c-9aac-4ff5-b51e-4d39741e9693]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7ec9c-c383-47ef-ac04-9cf7697ac8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-394800742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d59ee195a4436e90a37d61eff50110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:03Z,use_quota=True,user_id='154916bfdcaf4f14a7bf78b724715d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff7d64-6889-4347-bb4d-668d580f22a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff7d64-6889-4347-bb4d-668d580f22a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bf95fb-5072-4168-a9af-7f0df2c69272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bf95fb-5072-4168-a9af-7f0df2c69272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2', 'volume_name': 'volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b254a63-4828-42cc-a22e-28fd8d7590d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b254a63-4828-42cc-a22e-28fd8d7590d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4028e65a-086d-48e7-9701-1c4944e45b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:03 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2', 'volume_size': 1} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-91b5ba38-3842-4a86-a272-7fe329995e22 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Terminate volume connection completed successfully. Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-91b5ba38-3842-4a86-a272-7fe329995e22 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Deleting attachment 958197a1-4552-4e60-b2b8-3e23f34dbfbb. {{(pid=84171) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 16:15:03 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:15:03 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "cinder-4e9f6d38-8465-44db-a167-943a4e68113b-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-4e9f6d38-8465-44db-a167-943a4e68113b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "cinder-quobyte-4e9f6d38-8465-44db-a167-943a4e68113b" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-quobyte-4e9f6d38-8465-44db-a167-943a4e68113b" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8318825-dae0-432b-a863-73ef9657a784]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:04 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.773s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:04 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 Apr 28 16:15:04 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:04 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b Apr 28 16:15:04 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:04 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b" returned: 0 in 0.704s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:04 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b Apr 28 16:15:04 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:05 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4e9f6d38-8465-44db-a167-943a4e68113b" returned: 0 in 1.211s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-quobyte-4e9f6d38-8465-44db-a167-943a4e68113b" released by "delete_volume" :: held 2.014s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.quota [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Created reservations ['a6133c23-a1d9-4447-9e20-53408de66fe0', 'd674b30c-83ab-4265-87a7-743ab8ab2028', '803e7d52-cf40-45fb-8c65-eef3230ade60', '8d05e7bc-bd3c-45cc-be70-0530e2575016'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:06 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:06 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (c0a8b8e4-4c16-4114-8a82-862e9d20017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac8139b-fcaf-4d21-bc75-bc4815febe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac8139b-fcaf-4d21-bc75-bc4815febe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1279623206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73b744f-13fb-4bd0-9325-d495c8663cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:07Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d22d7c3-6b53-4cda-990a-ca57c77765d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d22d7c3-6b53-4cda-990a-ca57c77765d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34cbac3-6bd6-4848-9f2d-89b65d24c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34cbac3-6bd6-4848-9f2d-89b65d24c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73b744f-13fb-4bd0-9325-d495c8663cbe', 'volume_name': 'volume-b73b744f-13fb-4bd0-9325-d495c8663cbe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8fab7-0aef-4223-b742-3c942757ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c8fab7-0aef-4223-b742-3c942757ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c265b6-aae6-4c9e-b8b3-6241a4a52d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Volume b73b744f-13fb-4bd0-9325-d495c8663cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73b744f-13fb-4bd0-9325-d495c8663cbe', 'volume_size': 1} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:07 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.446s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.manager [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Deleted volume successfully. Apr 28 16:15:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [req-dfbc93ef-d663-4a8d-bcdf-143793c913b7 req-adc6d7ca-9c04-49f9-a91f-65a1d2a0ec01 tempest-ServerBootFromVolumeStableRescueTest-605669582 None] Lock "cinder-4e9f6d38-8465-44db-a167-943a4e68113b-delete_volume" released by "delete_volume" :: held 3.917s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:09 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9" returned: 0 in 5.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:09 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e8536-3118-4c49-a1a6-27a66749d42f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:09 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:15:09 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:10 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.891s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:10 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:15:10 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Converted 1024.00 MB image at 181.91 MB/s Apr 28 16:15:10 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 is being set with open permissions: ugo+rw Apr 28 16:15:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:10 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 Apr 28 16:15:10 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:11 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9" returned: 0 in 0.812s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" released by "_copy_volume_from_snapshot" :: held 9.048s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff-5e71fec1-335a-47ba-944c-ccefbad302a9" released by "_create_volume_from_snapshot" :: held 9.088s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.105s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.081s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-394800742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d59ee195a4436e90a37d61eff50110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:03Z,use_quota=True,user_id='154916bfdcaf4f14a7bf78b724715d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Creating volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:11 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:11 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 1073741824 Apr 28 16:15:11 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a7182c-b93e-4cf0-bab6-9effe5d082bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e71fec1-335a-47ba-944c-ccefbad302a9', 'volume_size': 1, 'snapshot_id': '99c37a2a-14b9-4d63-ae14-70496df5b2ff'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ea21dd-aa63-4389-ba7d-805445055a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:11 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Volume volume-5e71fec1-335a-47ba-944c-ccefbad302a9 (5e71fec1-335a-47ba-944c-ccefbad302a9): created successfully Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ea21dd-aa63-4389-ba7d-805445055a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Flow 'volume_create_manager' (384b77a1-2f01-42da-945c-f3bafac99b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:11 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-eca7e407-5da0-4d10-b2a0-235f56ce443e tempest-VolumesDeleteCascade-1592968505 None] Created volume successfully. Apr 28 16:15:12 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 1073741824" returned: 0 in 0.828s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-503c7710-aa7f-4189-9b20-0e2b834c3382-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:12 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 Apr 28 16:15:12 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-503c7710-aa7f-4189-9b20-0e2b834c3382-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Performing cascade delete. {{(pid=84171) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-99c37a2a-14b9-4d63-ae14-70496df5b2ff-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-99c37a2a-14b9-4d63-ae14-70496df5b2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Deleting offline snapshot 99c37a2a-14b9-4d63-ae14-70496df5b2ff of volume 503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] snapshot_file for this snap is: volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e5abfc-b56e-4afd-b18a-a97eaf5a08eb]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:12 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:15:12 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:13 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" returned: 0 in 0.721s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.024s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1279623206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73b744f-13fb-4bd0-9325-d495c8663cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:07Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Creating volume b73b744f-13fb-4bd0-9325-d495c8663cbe {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:13 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:13 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe 1073741824 Apr 28 16:15:13 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4028e65a-086d-48e7-9701-1c4944e45b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dceae1c-1b45-4efb-87bb-faecacd06394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:13 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Volume volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 (37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2): created successfully Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dceae1c-1b45-4efb-87bb-faecacd06394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Flow 'volume_create_manager' (eec0dbac-adc5-426e-b164-253530c626d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:13 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7ccf5e79-7525-43c0-a9ca-9dbbd76258ff tempest-SnapshotsActionsTest-1731632724 None] Created volume successfully. Apr 28 16:15:13 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.797s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-503c7710-aa7f-4189-9b20-0e2b834c3382(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[73daa08a-a1e1-4327-b12b-3631823811e4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:13 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:15:13 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:13 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe 1073741824" returned: 0 in 0.753s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:13 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe Apr 28 16:15:13 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:14 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:14 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:15:14 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:14 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe" returned: 0 in 0.677s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Creating offline snapshot b30c5df3-3695-468f-8f53-d4ae5046f76a of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c265b6-aae6-4c9e-b8b3-6241a4a52d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73b744f-13fb-4bd0-9325-d495c8663cbe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8b463f-641b-472d-afbe-9f7ba17f5579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32b74e-163e-4e99-b28f-1a2b7d85dff9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Volume volume-b73b744f-13fb-4bd0-9325-d495c8663cbe (b73b744f-13fb-4bd0-9325-d495c8663cbe): created successfully Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f8b463f-641b-472d-afbe-9f7ba17f5579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (c0a8b8e4-4c16-4114-8a82-862e9d20017b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:14 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5eb763b8-501d-495f-b0ce-4bfc059edc27 tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:15:14 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 Apr 28 16:15:14 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:14 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.769s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:15 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff Apr 28 16:15:15 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:15 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" returned: 0 in 0.720s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:15 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a 1G Apr 28 16:15:15 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:15 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382.99c37a2a-14b9-4d63-ae14-70496df5b2ff" returned: 0 in 0.711s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-99c37a2a-14b9-4d63-ae14-70496df5b2ff" released by "_delete_snapshot" :: held 3.117s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" released by "delete_snapshot" :: held 3.149s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['c9dea008-5dec-4264-a041-f0cc535467cf', '5fc353f1-9029-468f-888d-410d2a877d53', '0a46040a-815d-4279-9832-a879aa9531a2', 'bef8c106-b411-4eab-94b7-2275f6ab467b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-b73b744f-13fb-4bd0-9325-d495c8663cbe-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "cinder-b73b744f-13fb-4bd0-9325-d495c8663cbe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Delete snapshot completed successfully. Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-99c37a2a-14b9-4d63-ae14-70496df5b2ff-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Snapshots deleted, issuing volume delete {{(pid=84171) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-quobyte-b73b744f-13fb-4bd0-9325-d495c8663cbe" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aef985-3dcf-4de3-a2a5-b16b2d239b97]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-b73b744f-13fb-4bd0-9325-d495c8663cbe" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120e126-bd5d-4446-818d-07b553b81c78]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:16 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:15:16 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:16 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe Apr 28 16:15:16 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:16 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a 1G" returned: 0 in 0.899s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:16 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:16 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:16 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe" returned: 0 in 0.803s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:16 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.857s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:16 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe Apr 28 16:15:16 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:16 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382 Apr 28 16:15:16 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:16 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.725s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:16 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a is being set with open permissions: ugo+rw Apr 28 16:15:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:17 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:17 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:17 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-b73b744f-13fb-4bd0-9325-d495c8663cbe" returned: 0 in 0.704s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-b73b744f-13fb-4bd0-9325-d495c8663cbe" released by "delete_volume" :: held 1.560s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:17 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-503c7710-aa7f-4189-9b20-0e2b834c3382" returned: 0 in 0.731s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-503c7710-aa7f-4189-9b20-0e2b834c3382" released by "delete_volume" :: held 1.664s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Created reservations ['6da41ca8-13bb-48aa-9126-2bfa7b26d7e5', '74a35746-23ea-46ae-ab0b-aad736f18e72', '6377e5c6-7be1-4d6f-a6a7-3e00a1fe20bf', 'f96722e5-ef58-4186-91e3-80b246903fda'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:17 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['335304f7-dd40-4140-bf7a-f7608f3a0bfa', 'fd64ace9-67e9-499e-85c3-db9f596edff3', 'a9a63e68-0be3-4c75-9c4b-f34dbafc3602', '1ded807a-f9e0-4861-bdf9-b4daa1d5dc7a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:17 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info Apr 28 16:15:17 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:17 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:17 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:17 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:17 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-5e71fec1-335a-47ba-944c-ccefbad302a9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-5e71fec1-335a-47ba-944c-ccefbad302a9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" acquired by "delete_volume" :: waited 0.048s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af84c2-f4b0-458b-b656-a3c35b1debef]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:18 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.915s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Deleted volume successfully. Apr 28 16:15:18 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 Apr 28 16:15:18 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-6ebfabd0-2c5b-41ad-ab03-cb89f3285419 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-503c7710-aa7f-4189-9b20-0e2b834c3382-delete_volume" released by "delete_volume" :: held 6.364s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:18 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.060s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Deleted volume successfully. Apr 28 16:15:18 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info" returned: 0 in 1.119s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:18 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info is being set with open permissions: ugo+rw Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c361d092-a764-473c-870f-92b06bd56b2c tempest-VolumesActionsTest-1001085761 None] Lock "cinder-b73b744f-13fb-4bd0-9325-d495c8663cbe-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:18 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info Apr 28 16:15:18 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:18 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (6b03052b-a66e-4a2c-9edf-c19380faee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc9be3f-bc7d-4a44-9048-f6ee900ed924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc9be3f-bc7d-4a44-9048-f6ee900ed924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584435094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e21f3-0398-4625-a7f8-548759fc8498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:19Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e748db-8c71-4b60-918b-ab76edd278e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e748db-8c71-4b60-918b-ab76edd278e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274631fd-7e60-4280-a631-59f43b200ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274631fd-7e60-4280-a631-59f43b200ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6e21f3-0398-4625-a7f8-548759fc8498', 'volume_name': 'volume-2e6e21f3-0398-4625-a7f8-548759fc8498', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8906544-7973-4b3d-9bde-e3b1b593ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8906544-7973-4b3d-9bde-e3b1b593ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287bc298-c4ff-4645-9ca1-14e162cabe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:19 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Volume 2e6e21f3-0398-4625-a7f8-548759fc8498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6e21f3-0398-4625-a7f8-548759fc8498', 'volume_size': 1} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:19 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9" returned: 0 in 0.894s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:19 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9 Apr 28 16:15:19 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:19 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.info" returned: 0 in 0.681s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.953s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584435094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6e21f3-0398-4625-a7f8-548759fc8498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:19Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Creating volume 2e6e21f3-0398-4625-a7f8-548759fc8498 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:19 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:19 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 1073741824 Apr 28 16:15:19 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:19 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-452a10ce-de1f-486b-8c18-570705448977 tempest-SnapshotsActionsTest-1731632724 None] Create snapshot completed successfully Apr 28 16:15:20 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e71fec1-335a-47ba-944c-ccefbad302a9" returned: 0 in 0.705s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-quobyte-5e71fec1-335a-47ba-944c-ccefbad302a9" released by "delete_volume" :: held 1.671s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Created reservations ['33dacb53-41fe-4694-a730-5e37c7350cdf', '3b29f186-1c1e-4292-905c-0799351a0c17', '41f7e243-5047-483a-a939-a9bead23165d', '9bcafda6-ca3d-4ea3-80af-b2ae4f376aec'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:20 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:20 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:20 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 1073741824" returned: 0 in 1.115s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:20 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 Apr 28 16:15:20 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:21 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.873s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Deleted volume successfully. Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-891c221e-01cb-4bd7-80ec-01c2aed11f33 tempest-VolumesDeleteCascade-1592968505 None] Lock "cinder-5e71fec1-335a-47ba-944c-ccefbad302a9-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:21 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498" returned: 0 in 0.756s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.016s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287bc298-c4ff-4645-9ca1-14e162cabe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6e21f3-0398-4625-a7f8-548759fc8498', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b417b8c1-50b9-4295-9d7a-a7b11a465178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Creating offline snapshot ffb2c99d-a319-4ed9-bd42-98dd63569dfa of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:21 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Volume volume-2e6e21f3-0398-4625-a7f8-548759fc8498 (2e6e21f3-0398-4625-a7f8-548759fc8498): created successfully Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b417b8c1-50b9-4295-9d7a-a7b11a465178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (6b03052b-a66e-4a2c-9edf-c19380faee40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[438622c4-0038-4927-9d30-0b6efe2578fe]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e280a832-dfc7-45d4-a23f-bc8361e99fbb tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:15:21 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:21 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-2e6e21f3-0398-4625-a7f8-548759fc8498-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "cinder-2e6e21f3-0398-4625-a7f8-548759fc8498-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-quobyte-2e6e21f3-0398-4625-a7f8-548759fc8498" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-2e6e21f3-0398-4625-a7f8-548759fc8498" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a051b3d-e57b-4086-b424-c2bdb92cefbc]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:22 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 Apr 28 16:15:22 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:22 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 1.010s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:22 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa 1G Apr 28 16:15:22 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:23 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498" returned: 0 in 0.798s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:23 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498 Apr 28 16:15:23 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:23 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa 1G" returned: 0 in 1.042s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:23 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa Apr 28 16:15:23 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:24 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e6e21f3-0398-4625-a7f8-548759fc8498" returned: 0 in 0.836s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-2e6e21f3-0398-4625-a7f8-548759fc8498" released by "delete_volume" :: held 1.692s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Created reservations ['940658fb-5592-46ea-b823-b23ffab64c57', '4d0c57f3-e5b2-4b6f-b5de-42b68a9322b6', '96be6720-e9f7-4ade-96b1-a8a4d905b087', '7b6fbc4b-57df-42c3-b80a-1abcf5107711'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:24 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:24 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:24 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa" returned: 0 in 0.802s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:24 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa is being set with open permissions: ugo+rw Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:24 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa Apr 28 16:15:24 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Flow 'volume_create_manager' (c0f741c2-10af-477d-a663-62610b84a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83c2d7-59e4-4353-a55a-d791823680ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c83c2d7-59e4-4353-a55a-d791823680ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2046238989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cac721-898e-4dcd-95d2-ac4efbfc4bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91e1b29527941bc91d156514111ed4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:25Z,use_quota=True,user_id='06135bcde7254238b2d7cb65f14ec90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f0a511-aafb-46c5-9efd-8c3e57040d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f0a511-aafb-46c5-9efd-8c3e57040d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1d5030-8bf2-494e-a118-f9125ee79973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.image.glance [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Creating Keystone auth plugin from conf {{(pid=84171) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 16:15:24 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.665s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Deleted volume successfully. Apr 28 16:15:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4572523d-17ed-46db-b343-b6489a0fdbee tempest-VolumesActionsTest-1001085761 None] Lock "cinder-2e6e21f3-0398-4625-a7f8-548759fc8498-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:25 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa" returned: 0 in 0.907s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.927s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (be051f39-e54c-4936-9c88-bb3d005efd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901551bf-c997-41c8-99bb-967b944b8a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1d5030-8bf2-494e-a118-f9125ee79973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65cac721-898e-4dcd-95d2-ac4efbfc4bf5', 'volume_name': 'volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fdbc3f-55e5-4b42-aa60-f8ba1bc7eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fdbc3f-55e5-4b42-aa60-f8ba1bc7eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720f1c0c-2233-4db4-b4f7-207ad78d6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Trying to clone 65cac721-898e-4dcd-95d2-ac4efbfc4bf5 from image 15a518ba-55ac-48ec-8b87-111778c54a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]). {{(pid=84171) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 16:15:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d65f13d7-95bd-477d-955f-d7f89f0b4a0f tempest-SnapshotsActionsTest-1731632724 None] Create snapshot completed successfully Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901551bf-c997-41c8-99bb-967b944b8a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1821995023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9d739c-6169-484c-a6f6-001c1d0c0842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:25Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834d1242-c57b-48f0-82e6-9a5d1897f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834d1242-c57b-48f0-82e6-9a5d1897f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876e26ef-3fa0-4e42-ac6e-5c96cb1ca2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876e26ef-3fa0-4e42-ac6e-5c96cb1ca2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9d739c-6169-484c-a6f6-001c1d0c0842', 'volume_name': 'volume-0a9d739c-6169-484c-a6f6-001c1d0c0842', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b951fe51-538b-42f5-b6ba-983b03187eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b951fe51-538b-42f5-b6ba-983b03187eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c80732a-9a4b-403d-ba00-60d644cf8389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Volume 0a9d739c-6169-484c-a6f6-001c1d0c0842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9d739c-6169-484c-a6f6-001c1d0c0842', 'volume_size': 1} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1821995023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9d739c-6169-484c-a6f6-001c1d0c0842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:25Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Creating volume 0a9d739c-6169-484c-a6f6-001c1d0c0842 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:25 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 1073741824 Apr 28 16:15:25 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:25 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 16:15:25 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Image download 20.69 MB at 20.69 MB/s Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-ffb2c99d-a319-4ed9-bd42-98dd63569dfa-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7746720-53b5-41ea-b7e5-fa12d8ea5c6d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-ffb2c99d-a319-4ed9-bd42-98dd63569dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-ffb2c99d-a319-4ed9-bd42-98dd63569dfa" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-ffb2c99d-a319-4ed9-bd42-98dd63569dfa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Deleting offline snapshot ffb2c99d-a319-4ed9-bd42-98dd63569dfa of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] snapshot_file for this snap is: volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e725e4f4-a846-4632-9b0a-b718fac4c3b0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:26 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD Apr 28 16:15:26 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:26 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa Apr 28 16:15:26 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:26 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 1073741824" returned: 0 in 1.072s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:26 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 Apr 28 16:15:26 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:26 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:26 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b is fetched for user 06135bcde7254238b2d7cb65f14ec90e. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8fb0ba-1219-4665-b57d-bbee24f509f2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:27 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa" returned: 0 in 0.918s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e2957-c0c3-4c66-85a5-b2a9b10b25fe]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:27 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD Apr 28 16:15:27 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:27 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:27 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:27 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842" returned: 0 in 0.657s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c80732a-9a4b-403d-ba00-60d644cf8389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9d739c-6169-484c-a6f6-001c1d0c0842', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8ebc29-4be3-4acc-a0e9-694a4474cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Volume volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 (0a9d739c-6169-484c-a6f6-001c1d0c0842): created successfully Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8ebc29-4be3-4acc-a0e9-694a4474cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (be051f39-e54c-4936-9c88-bb3d005efd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8849be00-f91d-4a83-9d23-db16fa351722 tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-0a9d739c-6169-484c-a6f6-001c1d0c0842-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "cinder-0a9d739c-6169-484c-a6f6-001c1d0c0842-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-quobyte-0a9d739c-6169-484c-a6f6-001c1d0c0842" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-0a9d739c-6169-484c-a6f6-001c1d0c0842" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf29dd4-4849-4d08-b0da-a315810b3733]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:27 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2046238989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65cac721-898e-4dcd-95d2-ac4efbfc4bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91e1b29527941bc91d156514111ed4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:25Z,use_quota=True,user_id='06135bcde7254238b2d7cb65f14ec90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Creating volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:27 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:27 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1073741824 Apr 28 16:15:27 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:27 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 Apr 28 16:15:27 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:28 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.942s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:28 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa Apr 28 16:15:28 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:28 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842" returned: 0 in 0.804s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:28 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842 Apr 28 16:15:28 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:28 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1073741824" returned: 0 in 0.904s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:28 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:28 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:28 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa" returned: 0 in 0.853s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:28 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa Apr 28 16:15:28 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:29 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-0a9d739c-6169-484c-a6f6-001c1d0c0842" returned: 0 in 0.681s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-0a9d739c-6169-484c-a6f6-001c1d0c0842" released by "delete_volume" :: held 1.541s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Created reservations ['3d2b550c-89f9-47f6-9161-7d42e3c72ec1', 'f722de65-040a-4217-80fa-5dfd7662e46d', 'fe304287-39b9-42f4-bd27-dd5e56d2156d', '740587ec-b0b6-415f-a697-63a395be5656'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:29 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 0.662s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:29 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:29 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Attempting download of 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 16:15:29 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ffb2c99d-a319-4ed9-bd42-98dd63569dfa" returned: 0 in 0.658s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c6326d-9430-428a-bbd8-c61a9b6344f3]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-ffb2c99d-a319-4ed9-bd42-98dd63569dfa" released by "_delete_snapshot" :: held 3.518s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_snapshot" :: held 3.544s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Created reservations ['2caf6492-bf15-47ca-97d6-29083c688d18', '45d0623b-660d-468b-8c4c-478b85a14c62', '9d5182c2-6707-4b61-afb4-93cda15b2bd1', '7e4e2c20-607f-4804-b0ca-0c8c22fc6937'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:29 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x Apr 28 16:15:29 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Delete snapshot completed successfully. Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4023a189-a88c-4a88-be97-f1cd27196337 tempest-BackendsCapabilitiesAdminTestsJSON-878102992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6303215026855, 'free_capacity_gb': 1775.6303215026855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84171) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 16:15:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b7fffb4c-73d6-4b42-81a1-fb80c4e4e7c1 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-ffb2c99d-a319-4ed9-bd42-98dd63569dfa-delete_snapshot" released by "delete_snapshot" :: held 3.708s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:30 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.624s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Deleted volume successfully. Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34261748-891b-43d0-94e5-e1d52e1daeae tempest-VolumesActionsTest-1001085761 None] Lock "cinder-0a9d739c-6169-484c-a6f6-001c1d0c0842-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:30 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (f976c7d0-ff02-4758-beb9-7c59b4eccb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cf3ede-8ca0-48d7-a42b-de5d15e42c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2dcc11a4-0f68-44d0-a258-e8ccc66a61dd tempest-BackendsCapabilitiesAdminTestsJSON-878102992 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6303215026855, 'free_capacity_gb': 1775.6303215026855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84171) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57cf3ede-8ca0-48d7-a42b-de5d15e42c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-673462146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa2772-274a-43f4-8f25-6254005390f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:30Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e12290-645d-4c2a-8da1-a6140a34b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e12290-645d-4c2a-8da1-a6140a34b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f56cb2-d963-4bf4-a28b-59cd85f43ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f56cb2-d963-4bf4-a28b-59cd85f43ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fa2772-274a-43f4-8f25-6254005390f7', 'volume_name': 'volume-e3fa2772-274a-43f4-8f25-6254005390f7', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d87887f-fe45-4057-9476-69ba738efc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d87887f-fe45-4057-9476-69ba738efc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5430b004-03f8-4833-9608-69bf3a0d232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:30 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Volume e3fa2772-274a-43f4-8f25-6254005390f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fa2772-274a-43f4-8f25-6254005390f7', 'volume_size': 1} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-673462146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa2772-274a-43f4-8f25-6254005390f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:30Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Creating volume e3fa2772-274a-43f4-8f25-6254005390f7 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:30 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x Apr 28 16:15:30 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:30 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:30 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 1073741824 Apr 28 16:15:30 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:31 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x" returned: 1 in 0.732s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_dbotet3x' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c75428-b3a2-4190-acc5-b78672f37a2f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:31 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD Apr 28 16:15:31 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:31 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 1073741824" returned: 0 in 0.872s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:31 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 Apr 28 16:15:31 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:31 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] 15a518ba-55ac-48ec-8b87-111778c54a6b was qcow2, converting to raw {{(pid=84171) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 16:15:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:31 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:31 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:32 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7" returned: 0 in 0.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.357s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Creating offline snapshot b57c23c4-000f-4416-bc1b-d51ab795be32 of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5430b004-03f8-4833-9608-69bf3a0d232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fa2772-274a-43f4-8f25-6254005390f7', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b58439-c5f1-4cc0-9a90-355f0db9c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d301098-49eb-4198-be41-08be8abf2693]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:32 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Volume volume-e3fa2772-274a-43f4-8f25-6254005390f7 (e3fa2772-274a-43f4-8f25-6254005390f7): created successfully Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b58439-c5f1-4cc0-9a90-355f0db9c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (f976c7d0-ff02-4758-beb9-7c59b4eccb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:32 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0a42c63c-a774-48c4-8d59-05b039c1ea65 tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:15:32 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:32 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-e3fa2772-274a-43f4-8f25-6254005390f7-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-e3fa2772-274a-43f4-8f25-6254005390f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Acquiring lock "cinder-quobyte-e3fa2772-274a-43f4-8f25-6254005390f7" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-e3fa2772-274a-43f4-8f25-6254005390f7" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cea72-8bf9-4327-a099-ef9e601784ae]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:33 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.912s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:33 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 1G Apr 28 16:15:33 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:33 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 Apr 28 16:15:33 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:33 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7" returned: 0 in 0.905s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:33 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7 Apr 28 16:15:33 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:34 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 1G" returned: 0 in 1.050s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:34 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 Apr 28 16:15:34 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:34 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 2.338s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_30zzepwidevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:15:34 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Converted 112.00 MB image at 47.86 MB/s Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:34 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1G Apr 28 16:15:34 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:34 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e3fa2772-274a-43f4-8f25-6254005390f7" returned: 0 in 0.835s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-quobyte-e3fa2772-274a-43f4-8f25-6254005390f7" released by "delete_volume" :: held 1.810s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Created reservations ['00624f4e-a8cc-4832-93e5-148675465433', '86d68f40-05be-49b4-8731-a567cace6731', 'fa2650ea-06af-44ed-aa2f-12e3ea31d0e8', '897a5d01-a6c1-442c-82a9-dc35e5d1095d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:34 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:34 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 is being set with open permissions: ugo+rw Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:34 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 Apr 28 16:15:34 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:34 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:34 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:35 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 1G" returned: 0 in 0.825s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17efedb-44fa-4694-8830-7dabe4b25618]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:35 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:35 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:35 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32" returned: 0 in 0.824s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.740s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:35 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.900s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Deleted volume successfully. Apr 28 16:15:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2ef62625-9fb9-4739-adef-10a6425876a6 tempest-SnapshotsActionsTest-1731632724 None] Create snapshot completed successfully Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (09053a80-a71a-4eb6-b1f8-157d05f6233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263ee344-6845-4d7c-8693-f067f19cfe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed72a337-ad5d-456c-97e2-3e70430adfd1 tempest-VolumesActionsTest-1001085761 None] Lock "cinder-e3fa2772-274a-43f4-8f25-6254005390f7-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263ee344-6845-4d7c-8693-f067f19cfe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2113838995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:36Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0ef05-2a75-44ec-aa91-2e73db07c195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0ef05-2a75-44ec-aa91-2e73db07c195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23b6273-09e1-49a6-b312-35e2689be05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23b6273-09e1-49a6-b312-35e2689be05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd', 'volume_name': 'volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f1489-f45b-4454-902e-3c276ef26972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f1489-f45b-4454-902e-3c276ef26972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dae28dc-3599-44b2-9920-6796117d2f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Volume 5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd', 'volume_size': 1} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2113838995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5302ec35f44c59922f1c3ea8cda66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:36Z,use_quota=True,user_id='e1a74dc8728a48059a017bf538c5631e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Creating volume 5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:35 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:36 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd 1073741824 Apr 28 16:15:36 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:36 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 0.945s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-b57c23c4-000f-4416-bc1b-d51ab795be32-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-b57c23c4-000f-4416-bc1b-d51ab795be32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-b57c23c4-000f-4416-bc1b-d51ab795be32" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-b57c23c4-000f-4416-bc1b-d51ab795be32" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Deleting offline snapshot b57c23c4-000f-4416-bc1b-d51ab795be32 of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:36 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:36 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] snapshot_file for this snap is: volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572b559-d40b-4ffb-b705-65192389b3e7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:36 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 Apr 28 16:15:36 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:36 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd 1073741824" returned: 0 in 0.916s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:36 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd Apr 28 16:15:36 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:36 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:36 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 1 in 0.899s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Downloaded image 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5 successfully. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b for user 06135bcde7254238b2d7cb65f14ec90e is deleted. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Marking volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5 as bootable. {{(pid=84171) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32" returned: 0 in 0.763s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:36 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Copying metadata from image 15a518ba-55ac-48ec-8b87-111778c54a6b to 65cac721-898e-4dcd-95d2-ac4efbfc4bf5. {{(pid=84171) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Creating volume glance metadata for volume 65cac721-898e-4dcd-95d2-ac4efbfc4bf5 backed by image 15a518ba-55ac-48ec-8b87-111778c54a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84171) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3e6451-5177-4058-b962-fc3043ba859a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720f1c0c-2233-4db4-b4f7-207ad78d6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20319c68-e06e-44d6-bad2-4bc581b35c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:37 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Volume volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 (65cac721-898e-4dcd-95d2-ac4efbfc4bf5): created successfully Apr 28 16:15:37 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20319c68-e06e-44d6-bad2-4bc581b35c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Flow 'volume_create_manager' (c0f741c2-10af-477d-a663-62610b84a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cb7d473e-bb3b-40b2-9413-88193a0b0b92 tempest-VolumesExtendTest-1743277499 None] Created volume successfully. Apr 28 16:15:37 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" returned: 0 in 0.671s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dae28dc-3599-44b2-9920-6796117d2f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a466e74-d74b-4b89-99f7-60086b5bbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Volume volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd (5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd): created successfully Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a466e74-d74b-4b89-99f7-60086b5bbffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Flow 'volume_create_manager' (09053a80-a71a-4eb6-b1f8-157d05f6233c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a489c83c-0598-4fb0-b677-de56982f0e6d tempest-VolumesActionsTest-771568387 None] Created volume successfully. Apr 28 16:15:37 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.782s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:37 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 Apr 28 16:15:37 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4cd36-9553-4e51-b326-4a09deb57bc6]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:38 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:38 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Flow 'volume_create_manager' (e9a48cf5-fdf5-449e-9fe3-dd3512d6c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3446f810-9242-4abb-a45d-70d67110df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3446f810-9242-4abb-a45d-70d67110df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522967607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc47f917-91d0-463e-90a7-8a54bd3b3942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90ae4042a341779a63aef066302fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:38Z,use_quota=True,user_id='539be1be559646c585eac6c5d7d500cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c5db9c-5e07-4d82-9c1e-23757988fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c5db9c-5e07-4d82-9c1e-23757988fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb558e9d-ab2e-4000-ac98-2e0a054c4ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb558e9d-ab2e-4000-ac98-2e0a054c4ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc47f917-91d0-463e-90a7-8a54bd3b3942', 'volume_name': 'volume-cc47f917-91d0-463e-90a7-8a54bd3b3942', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f37994-93a0-49b5-b633-2615b0afec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f37994-93a0-49b5-b633-2615b0afec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ca02c6-b5d4-4d87-b125-03b398cc59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:38 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume cc47f917-91d0-463e-90a7-8a54bd3b3942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc47f917-91d0-463e-90a7-8a54bd3b3942', 'volume_size': 1} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:38 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32" returned: 0 in 0.846s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:38 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32 Apr 28 16:15:38 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "cinder-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:39 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 0.850s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Acquiring lock "cinder-quobyte-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "cinder-quobyte-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" acquired by "delete_volume" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7e82a4-5f1f-40f3-ae20-44c60ea1e6bb]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:39 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:39 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:39 devstack sudo[90101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd Apr 28 16:15:39 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:39 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b57c23c4-000f-4416-bc1b-d51ab795be32" returned: 0 in 0.672s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-b57c23c4-000f-4416-bc1b-d51ab795be32" released by "_delete_snapshot" :: held 3.187s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_snapshot" :: held 3.218s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Created reservations ['f431d014-9c36-4f98-a440-cb34d1684bce', 'ae996982-5bbb-4175-ba05-d800aaf7476e', 'fc375f01-b513-4af7-8325-77e7e6a87498', '94024e00-342d-48ae-9dd6-cec6c01df05a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Delete snapshot completed successfully. Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f3a86924-9f4c-47f2-b88e-669b31b449d7 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-b57c23c4-000f-4416-bc1b-d51ab795be32-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:39 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 1 in 0.767s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 2G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:39 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:39 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd Apr 28 16:15:39 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 2G" returned: 0 in 0.064s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.752s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.329s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522967607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc47f917-91d0-463e-90a7-8a54bd3b3942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90ae4042a341779a63aef066302fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:38Z,use_quota=True,user_id='539be1be559646c585eac6c5d7d500cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Creating volume cc47f917-91d0-463e-90a7-8a54bd3b3942 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:39 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:39 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 1073741824 Apr 28 16:15:39 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1ee1576d-e237-4e1f-adc6-aa1347d2e9f2 tempest-VolumesExtendTest-1743277499 None] Extend volume completed successfully. Apr 28 16:15:40 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" returned: 0 in 0.652s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "cinder-quobyte-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd" released by "delete_volume" :: held 1.432s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Created reservations ['a42a7353-e472-4988-8256-48c6cbc4c2ed', 'b5a14fc7-4deb-4101-8261-d46c636f642c', '58bad8c6-e0da-48c3-8be3-0113ba166dd3', 'aba4850f-de7b-4f32-9a65-208b1633027e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-65cac721-898e-4dcd-95d2-ac4efbfc4bf5-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "cinder-65cac721-898e-4dcd-95d2-ac4efbfc4bf5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:40 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:40 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-quobyte-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa798cf9-fc3d-4c3c-a5fa-200da4d6ba10]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:40 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 1073741824" returned: 0 in 0.965s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:40 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 Apr 28 16:15:40 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:40 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:40 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:41 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.660s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Deleted volume successfully. Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c546f524-a830-4e15-b1db-90dad241e416 tempest-VolumesActionsTest-771568387 None] Lock "cinder-5e63b9a3-3ddb-4a4a-a73c-92a33d4d22fd-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:41 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942" returned: 0 in 0.638s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Creating offline snapshot ef67b69a-863a-4893-afd3-b6c7df094213 of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:41 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ca02c6-b5d4-4d87-b125-03b398cc59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc47f917-91d0-463e-90a7-8a54bd3b3942', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeb372e-98b3-43d3-a1a6-6c2e758c5037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 0.798s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9026b3-9578-4a8c-a67e-c498563bf675]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:41 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 (cc47f917-91d0-463e-90a7-8a54bd3b3942): created successfully Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdeb372e-98b3-43d3-a1a6-6c2e758c5037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Flow 'volume_create_manager' (e9a48cf5-fdf5-449e-9fe3-dd3512d6c974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c3644f5a-110b-414a-a673-e93d151bd8b9 tempest-VolumeQuotasAdminTestJSON-254683797 None] Created volume successfully. Apr 28 16:15:41 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:41 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:41 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:41 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:42 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 1 in 0.782s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:42 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.780s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:42 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5 Apr 28 16:15:42 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:42 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 1G Apr 28 16:15:42 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "cinder-cc47f917-91d0-463e-90a7-8a54bd3b3942-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "cinder-cc47f917-91d0-463e-90a7-8a54bd3b3942-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "cinder-quobyte-cc47f917-91d0-463e-90a7-8a54bd3b3942" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "cinder-quobyte-cc47f917-91d0-463e-90a7-8a54bd3b3942" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[06754ec4-620c-42b7-8eb7-21a3247ead95]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:43 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" returned: 0 in 0.724s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-65cac721-898e-4dcd-95d2-ac4efbfc4bf5" released by "delete_volume" :: held 2.377s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:43 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 Apr 28 16:15:43 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Created reservations ['4949b01b-b082-42e3-a114-79a7329f57d3', '7a982e28-688f-48a9-9002-d5a5de014781', '541ff136-8bca-47b4-ac92-2bb9c0432b81', '097997bd-baca-4b26-87ce-352eddf9294a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:43 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:43 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:43 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 1G" returned: 0 in 1.031s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:43 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 Apr 28 16:15:43 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:44 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942" returned: 0 in 0.927s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:44 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Deleted volume successfully. Apr 28 16:15:44 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942 Apr 28 16:15:44 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed13892a-a8e0-4d7c-ae9f-f9246f7c0c2a tempest-VolumesExtendTest-1743277499 None] Lock "cinder-65cac721-898e-4dcd-95d2-ac4efbfc4bf5-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:44 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213" returned: 0 in 0.911s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:44 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 is being set with open permissions: ugo+rw Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:44 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 Apr 28 16:15:44 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=142,cinder:UPDATE=170,cinder:INSERT=50,cinder:DELETE=14 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=179,cinder:SELECT=145,cinder:INSERT=43,cinder:DELETE=12 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Flow 'volume_create_manager' (aee3e1c8-dd4f-4bbb-adc8-1b24555ee6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193fe3b-9571-4ec1-bc2b-b02050f30aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193fe3b-9571-4ec1-bc2b-b02050f30aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704653240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50054aa4-1d44-477f-a010-e91fe7d5773e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91e1b29527941bc91d156514111ed4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:45Z,use_quota=True,user_id='06135bcde7254238b2d7cb65f14ec90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc0329-4562-4276-b61d-e8ec4a8e2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecc0329-4562-4276-b61d-e8ec4a8e2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dab6739-6205-4578-b8a9-f3420320f652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dab6739-6205-4578-b8a9-f3420320f652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50054aa4-1d44-477f-a010-e91fe7d5773e', 'volume_name': 'volume-50054aa4-1d44-477f-a010-e91fe7d5773e', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e946a4a4-6246-4a51-b200-1fb8b0a9cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e946a4a4-6246-4a51-b200-1fb8b0a9cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a3b4a7-c00d-46ec-87d9-15c19881941f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:44 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Volume 50054aa4-1d44-477f-a010-e91fe7d5773e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50054aa4-1d44-477f-a010-e91fe7d5773e', 'volume_size': 1} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:44 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cc47f917-91d0-463e-90a7-8a54bd3b3942" returned: 0 in 0.878s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "cinder-quobyte-cc47f917-91d0-463e-90a7-8a54bd3b3942" released by "delete_volume" :: held 1.860s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:44 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Created reservations ['2da05a1c-990a-4c37-bb85-b0924b17931d', '46269da4-35a0-45b7-8edc-9f2eb57ef2d8', '34d6a261-82bd-48bf-a3e0-0bf32cd714d8', '2c1e5410-f430-4f01-bee4-be58d2746904'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:45 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:45 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:45 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213" returned: 0 in 0.762s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.686s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1704653240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50054aa4-1d44-477f-a010-e91fe7d5773e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91e1b29527941bc91d156514111ed4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:45Z,use_quota=True,user_id='06135bcde7254238b2d7cb65f14ec90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Creating volume 50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:45 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:45 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e 1073741824 Apr 28 16:15:45 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2252d1b8-9d58-484a-b0bd-766cc25efab8 tempest-SnapshotsActionsTest-1731632724 None] Create snapshot completed successfully Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:45 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Flow 'volume_create_manager' (dad8d560-2d11-4191-952e-d210fbabd147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc3bbaf-ec29-4f7f-a919-495dac07c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.922s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Deleted volume successfully. Apr 28 16:15:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc3bbaf-ec29-4f7f-a919-495dac07c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-738787397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddecd646-ecc8-4b49-9be0-de6eb9f7a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90ae4042a341779a63aef066302fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:46Z,use_quota=True,user_id='539be1be559646c585eac6c5d7d500cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71320b84-4d37-48d7-8173-42bd81581d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71320b84-4d37-48d7-8173-42bd81581d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb16b5f-9172-4341-b9ef-519e3a867222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb16b5f-9172-4341-b9ef-519e3a867222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddecd646-ecc8-4b49-9be0-de6eb9f7a93b', 'volume_name': 'volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2bcd5f-4e72-41c2-bb89-13ef3b85bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2bcd5f-4e72-41c2-bb89-13ef3b85bdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97a6b2-eddc-4a8e-93ea-3d31449c6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:46 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume ddecd646-ecc8-4b49-9be0-de6eb9f7a93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b', 'volume_size': 1} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2445111d-beff-435c-a4d5-4843ee84aaae tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "cinder-cc47f917-91d0-463e-90a7-8a54bd3b3942-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-ef67b69a-863a-4893-afd3-b6c7df094213-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-ef67b69a-863a-4893-afd3-b6c7df094213-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-ef67b69a-863a-4893-afd3-b6c7df094213" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-ef67b69a-863a-4893-afd3-b6c7df094213" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Deleting offline snapshot ef67b69a-863a-4893-afd3-b6c7df094213 of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] snapshot_file for this snap is: volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b0d85a-3d4c-46b7-8e72-8a662a6f8035]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:46 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 Apr 28 16:15:46 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:46 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e 1073741824" returned: 0 in 1.170s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:46 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:15:46 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:47 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213" returned: 0 in 0.808s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8088af-c01d-4e60-8aae-ae1c97681d0f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:47 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 0.687s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-738787397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddecd646-ecc8-4b49-9be0-de6eb9f7a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc90ae4042a341779a63aef066302fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:46Z,use_quota=True,user_id='539be1be559646c585eac6c5d7d500cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Creating volume ddecd646-ecc8-4b49-9be0-de6eb9f7a93b {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:47 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:47 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b 1073741824 Apr 28 16:15:47 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a3b4a7-c00d-46ec-87d9-15c19881941f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50054aa4-1d44-477f-a010-e91fe7d5773e', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8f99ba-e985-483c-8485-7791d07a03ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:47 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:47 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:47 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Volume volume-50054aa4-1d44-477f-a010-e91fe7d5773e (50054aa4-1d44-477f-a010-e91fe7d5773e): created successfully Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8f99ba-e985-483c-8485-7791d07a03ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Flow 'volume_create_manager' (aee3e1c8-dd4f-4bbb-adc8-1b24555ee6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:47 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-323389aa-a1b4-4f11-b444-f01cec4ab064 tempest-VolumesExtendTest-1743277499 None] Created volume successfully. Apr 28 16:15:47 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:47 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 Apr 28 16:15:47 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:48 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b 1073741824" returned: 0 in 0.961s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:48 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b Apr 28 16:15:48 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:48 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213" returned: 0 in 0.877s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:48 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213 Apr 28 16:15:48 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:48 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" returned: 0 in 0.678s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.632s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Creating offline snapshot 39018afa-0415-4657-9ae3-9830c9cfb2c3 of volume 50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb97a6b2-eddc-4a8e-93ea-3d31449c6d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185bb7b-377e-4fc2-a77b-aad5dee83989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b12d0-00af-44c8-be8f-bb62ae4e0bd4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:48 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Volume volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b (ddecd646-ecc8-4b49-9be0-de6eb9f7a93b): created successfully Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185bb7b-377e-4fc2-a77b-aad5dee83989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Flow 'volume_create_manager' (dad8d560-2d11-4191-952e-d210fbabd147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b30bc1d0-74d8-4a37-83d9-5ee96c46ee91 tempest-VolumeQuotasAdminTestJSON-254683797 None] Created volume successfully. Apr 28 16:15:49 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:15:49 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:49 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.ef67b69a-863a-4893-afd3-b6c7df094213" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-ef67b69a-863a-4893-afd3-b6c7df094213" released by "_delete_snapshot" :: held 3.263s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_snapshot" :: held 3.289s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Created reservations ['1072a882-c5e6-45f7-a4dc-d1b794690a0d', 'eb9753c9-e15c-48a7-bb89-c4fc8e7ac17d', '44fc62a0-25bb-46bf-9585-d7d5f2c062d0', 'ef330a06-7e51-4154-86da-acc6d0757f5b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Delete snapshot completed successfully. Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0f1a56ed-0578-44f1-b11b-e4e8ccf7a189 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-ef67b69a-863a-4893-afd3-b6c7df094213-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:49 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 0.953s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:49 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 1G Apr 28 16:15:49 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-bc26f27a-76a7-4c64-a2a8-eaea272e90e5 tempest-VolumeQuotasAdminTestJSON-1307180510 None] Transfer volume completed successfully. Apr 28 16:15:50 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 1G" returned: 0 in 0.960s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50054aa4-1d44-477f-a010-e91fe7d5773e -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:50 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50054aa4-1d44-477f-a010-e91fe7d5773e -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 Apr 28 16:15:50 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Acquiring lock "cinder-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "cinder-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Acquiring lock "cinder-quobyte-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "cinder-quobyte-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea6da7-b9c8-4eeb-a27f-5c5a10fca103]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:51 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b Apr 28 16:15:51 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:51 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50054aa4-1d44-477f-a010-e91fe7d5773e -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3" returned: 0 in 0.737s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:51 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 is being set with open permissions: ugo+rw Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:51 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 Apr 28 16:15:51 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:51 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" returned: 0 in 0.770s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:52 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b Apr 28 16:15:52 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:52 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3" returned: 0 in 0.620s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:52 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info Apr 28 16:15:52 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:52 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" returned: 0 in 0.629s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "cinder-quobyte-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b" released by "delete_volume" :: held 1.456s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Created reservations ['9ae3c008-35b0-4921-8318-3b6c39f306d9', '38ebe930-36a1-44bb-a9b6-a49d7d8782c2', '0544220e-e596-4e1a-929f-aaeadffba232', 'e3017bf0-4feb-4c91-9a96-a2b424d68fdc'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:52 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:15:52 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:52 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:52 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info is being set with open permissions: ugo+rw Apr 28 16:15:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:52 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info Apr 28 16:15:52 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:53 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.646s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:15:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Deleted volume successfully. Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c0f0aa44-767e-448b-8c80-f84e1280727f tempest-VolumeQuotasAdminTestJSON-179856630 None] Lock "cinder-ddecd646-ecc8-4b49-9be0-de6eb9f7a93b-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:15:53 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.info" returned: 0 in 0.696s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.751s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.661s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Creating offline snapshot fa81f102-b277-4bf0-934c-e40f2da4b33c of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:15:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-642d68f1-52fa-44d0-8a95-1066c95714ff tempest-VolumesExtendTest-1743277499 None] Create snapshot completed successfully Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd788b0-abd8-4497-bec9-cda0ddf5f20a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:53 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:53 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:54 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.764s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:54 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c 1G Apr 28 16:15:54 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:55 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c 1G" returned: 0 in 0.958s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:55 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c Apr 28 16:15:55 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:56 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c" returned: 0 in 0.782s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:56 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c is being set with open permissions: ugo+rw Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:56 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c Apr 28 16:15:56 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:56 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c" returned: 0 in 0.705s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.353s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.318s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba8f35c-a1bf-48df-bacf-091c9e9000e4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d211951a-8834-4a66-b6a1-06c62294fb69 tempest-SnapshotsActionsTest-1731632724 None] Create snapshot completed successfully Apr 28 16:15:57 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:15:57 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-fa81f102-b277-4bf0-934c-e40f2da4b33c-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-fa81f102-b277-4bf0-934c-e40f2da4b33c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Acquiring lock "cinder-quobyte-fa81f102-b277-4bf0-934c-e40f2da4b33c" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-fa81f102-b277-4bf0-934c-e40f2da4b33c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Deleting offline snapshot fa81f102-b277-4bf0-934c-e40f2da4b33c of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] snapshot_file for this snap is: volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[986df75b-afcf-4451-8994-b803dfcd9d59]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:57 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c Apr 28 16:15:57 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Flow 'volume_create_manager' (aa7865be-4991-46e0-a968-71826b806c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24659848-fc06-46ea-ad26-f6845dc2daee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24659848-fc06-46ea-ad26-f6845dc2daee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1870555242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0beeb47-bb71-4d61-bf29-17853b78e963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6951e157cf45e78389f11521512f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:58Z,use_quota=True,user_id='9695260a6eb341c9821054d8fd39ae3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85fb98-ba37-4262-91f0-0cd74c512be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d85fb98-ba37-4262-91f0-0cd74c512be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797348db-0d5a-43d0-b84f-8c7646c19c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797348db-0d5a-43d0-b84f-8c7646c19c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0beeb47-bb71-4d61-bf29-17853b78e963', 'volume_name': 'volume-a0beeb47-bb71-4d61-bf29-17853b78e963', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3498a18-9310-4b8d-a5f7-eec7b20af953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3498a18-9310-4b8d-a5f7-eec7b20af953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2d167-921a-48a4-8249-68e1d0c73075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:57 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Volume a0beeb47-bb71-4d61-bf29-17853b78e963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0beeb47-bb71-4d61-bf29-17853b78e963', 'volume_size': 1} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:57 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 0.919s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 2G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 2G" returned: 0 in 0.169s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.137s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1870555242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0beeb47-bb71-4d61-bf29-17853b78e963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6951e157cf45e78389f11521512f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:15:58Z,use_quota=True,user_id='9695260a6eb341c9821054d8fd39ae3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Creating volume a0beeb47-bb71-4d61-bf29-17853b78e963 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:15:58 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:58 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 1073741824 Apr 28 16:15:58 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:58 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-908744d2-cb24-40d2-96a0-2f4aa18f070c tempest-VolumesExtendTest-1743277499 None] Extend volume completed successfully. Apr 28 16:15:58 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c" returned: 0 in 0.881s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f6d6de-b11c-43f2-b187-639666ae1d7b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:58 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:15:58 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:58 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 1073741824" returned: 0 in 0.848s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:59 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 Apr 28 16:15:59 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-39018afa-0415-4657-9ae3-9830c9cfb2c3-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:59 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-39018afa-0415-4657-9ae3-9830c9cfb2c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-quobyte-39018afa-0415-4657-9ae3-9830c9cfb2c3" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:15:59 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c Apr 28 16:15:59 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-39018afa-0415-4657-9ae3-9830c9cfb2c3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Deleting offline snapshot 39018afa-0415-4657-9ae3-9830c9cfb2c3 of volume 50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] snapshot_file for this snap is: volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9d758-abb6-42fc-93b0-e14f3830a420]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:15:59 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 Apr 28 16:15:59 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:15:59 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963" returned: 0 in 0.650s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2d167-921a-48a4-8249-68e1d0c73075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0beeb47-bb71-4d61-bf29-17853b78e963', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a114c2-3c7c-4fbd-a1be-a95b71478071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:15:59 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Volume volume-a0beeb47-bb71-4d61-bf29-17853b78e963 (a0beeb47-bb71-4d61-bf29-17853b78e963): created successfully Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a114c2-3c7c-4fbd-a1be-a95b71478071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:15:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Flow 'volume_create_manager' (aa7865be-4991-46e0-a968-71826b806c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:15:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-6bf7b2ed-d8d8-407d-b16d-6fab7b900177 tempest-VolumesTransfersV355Test-487646114 None] Created volume successfully. Apr 28 16:16:00 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3" returned: 0 in 0.809s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50054aa4-1d44-477f-a010-e91fe7d5773e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:16:00 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c" returned: 0 in 0.956s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab4bc31-db14-47c8-a4ed-50d86b5b4dfb]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:00 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c Apr 28 16:16:00 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:00 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:16:00 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:00 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:00 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:00 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f04506fb-c971-44ec-8175-00a696ac0bfc tempest-VolumesTransfersV355Test-675412213 None] Transfer volume completed successfully. Apr 28 16:16:01 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.fa81f102-b277-4bf0-934c-e40f2da4b33c" returned: 0 in 0.820s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-fa81f102-b277-4bf0-934c-e40f2da4b33c" released by "_delete_snapshot" :: held 3.609s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_snapshot" :: held 3.642s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Created reservations ['7804e0d4-d049-4a0f-beda-b68d1c0e6327', '290277ee-fa0e-4759-b61c-d8ea4fcbeead', '567186b3-0ca4-4cb2-bb86-fa70b16bf5f0', '8393ac9d-ddb1-4b04-8bdb-5c1dbae559e6'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:01 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 0.955s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:01 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 Apr 28 16:16:01 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Delete snapshot completed successfully. Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-54ffc09e-d2b3-4ae3-aec4-66e2fe453d99 tempest-SnapshotsActionsTest-1522097895 None] Lock "cinder-fa81f102-b277-4bf0-934c-e40f2da4b33c-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:01 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.699s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "cinder-a0beeb47-bb71-4d61-bf29-17853b78e963-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:02 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3" returned: 0 in 1.060s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "cinder-b30c5df3-3695-468f-8f53-d4ae5046f76a-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-a0beeb47-bb71-4d61-bf29-17853b78e963-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:02 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3 Apr 28 16:16:02 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-b30c5df3-3695-468f-8f53-d4ae5046f76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "cinder-quobyte-a0beeb47-bb71-4d61-bf29-17853b78e963" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "cinder-quobyte-b30c5df3-3695-468f-8f53-d4ae5046f76a" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-quobyte-a0beeb47-bb71-4d61-bf29-17853b78e963" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-b30c5df3-3695-468f-8f53-d4ae5046f76a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Deleting offline snapshot b30c5df3-3695-468f-8f53-d4ae5046f76a of volume 37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] snapshot_file for this snap is: volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb1bad-1715-4a22-a237-fa4e42374624]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[40168667-e766-4610-90ad-acc34e2b5a84]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:02 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 Apr 28 16:16:02 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:02 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:16:02 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:03 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e.39018afa-0415-4657-9ae3-9830c9cfb2c3" returned: 0 in 0.879s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-39018afa-0415-4657-9ae3-9830c9cfb2c3" released by "_delete_snapshot" :: held 3.881s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" released by "delete_snapshot" :: held 3.924s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Created reservations ['68745c33-c823-484f-8d00-3b7247b455d7', '54937583-9685-4348-a390-c4f9f02d42f6', 'bed5541e-67fb-4466-a05b-89675bcd810e', '8fe18300-76ad-4d22-8dc7-b64ffdb408cf'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:03 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.869s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:16:03 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963" returned: 0 in 0.927s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feeda3b-9aa2-41f3-a357-6c9ebc1ea262]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:03 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963 Apr 28 16:16:03 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Delete snapshot completed successfully. Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-591b3c2f-5b76-42d5-a6f3-7b7b81e66bfb tempest-VolumesExtendTest-1743277499 None] Lock "cinder-39018afa-0415-4657-9ae3-9830c9cfb2c3-delete_snapshot" released by "delete_snapshot" :: held 4.211s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:03 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 Apr 28 16:16:03 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-50054aa4-1d44-477f-a010-e91fe7d5773e-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "cinder-50054aa4-1d44-477f-a010-e91fe7d5773e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9d714-b0ea-4787-a5c1-f22b945b82e6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:03 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:16:03 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:04 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a0beeb47-bb71-4d61-bf29-17853b78e963" returned: 0 in 0.840s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-quobyte-a0beeb47-bb71-4d61-bf29-17853b78e963" released by "delete_volume" :: held 1.842s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Created reservations ['12a13a2c-0d24-4cfd-b05a-e12efac6c235', 'cf1246df-e190-4927-a38d-40a2d52fe571', '520edbd0-34bd-4f3c-a244-008095dee8d0', '0b4d9745-e5c2-4e52-baea-17e37812f922'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:04 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" returned: 0 in 0.956s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:04 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:16:04 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:04 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:04 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:04 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 1.052s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:04 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e Apr 28 16:16:04 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:05 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.762s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:05 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Deleted volume successfully. Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3bcdfcd3-b18f-42a8-ac92-ccab90f7e265 tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-a0beeb47-bb71-4d61-bf29-17853b78e963-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:05 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:05 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a Apr 28 16:16:05 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Flow 'volume_create_manager' (7ffd1434-2e3a-4982-8dca-421f2b9cc512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994f34c-933e-49fc-a39b-809fa9b9331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994f34c-933e-49fc-a39b-809fa9b9331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1563319438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea10b00-6563-4a36-bebb-c083c569bce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6951e157cf45e78389f11521512f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:05Z,use_quota=True,user_id='9695260a6eb341c9821054d8fd39ae3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738defe0-0416-429a-8448-bdaecf63329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738defe0-0416-429a-8448-bdaecf63329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd5376d-4bc1-4ef6-9957-b79fc7d0ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd5376d-4bc1-4ef6-9957-b79fc7d0ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea10b00-6563-4a36-bebb-c083c569bce4', 'volume_name': 'volume-7ea10b00-6563-4a36-bebb-c083c569bce4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45547fd1-dc1d-40a9-a6a3-0ce0afec1cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45547fd1-dc1d-40a9-a6a3-0ce0afec1cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718560f3-8f84-4524-8997-f92c0954862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:05 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Volume 7ea10b00-6563-4a36-bebb-c083c569bce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea10b00-6563-4a36-bebb-c083c569bce4', 'volume_size': 1} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1563319438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea10b00-6563-4a36-bebb-c083c569bce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6951e157cf45e78389f11521512f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:05Z,use_quota=True,user_id='9695260a6eb341c9821054d8fd39ae3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Creating volume 7ea10b00-6563-4a36-bebb-c083c569bce4 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:05 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:05 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 1073741824 Apr 28 16:16:05 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:05 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-50054aa4-1d44-477f-a010-e91fe7d5773e" returned: 0 in 0.959s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "cinder-quobyte-50054aa4-1d44-477f-a010-e91fe7d5773e" released by "delete_volume" :: held 2.106s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Created reservations ['e4c961de-fc17-41bb-8654-1288d648b754', 'bfab8455-332e-4d63-a5ae-cc6b4ebf06d2', 'eb858220-f4bc-40cb-9fc3-78f9a13b4b29', '07710b6f-f35b-4a4d-8d00-ae82f77623ac'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:05 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2.b30c5df3-3695-468f-8f53-d4ae5046f76a" returned: 0 in 0.679s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-b30c5df3-3695-468f-8f53-d4ae5046f76a" released by "_delete_snapshot" :: held 3.583s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_snapshot" :: held 3.634s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:06 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:06 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Created reservations ['eb608939-80ad-4c88-94e0-73bce7a4fe70', '56f5044d-df47-4091-a42a-048c7de7f0a7', 'b90f0348-7523-4634-8569-f6d9f91cd508', 'edfa98df-0953-45ef-8b16-5c3244bebd93'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Delete snapshot completed successfully. Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9852f111-ee9f-42f1-bd4e-44b1f280ce84 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-b30c5df3-3695-468f-8f53-d4ae5046f76a-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:06 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 1073741824" returned: 0 in 1.006s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:06 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 Apr 28 16:16:06 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:06 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.640s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "cinder-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Deleted volume successfully. Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c88bcd6b-98d8-495a-878b-c99bb71e6977 tempest-VolumesExtendTest-1743277499 None] Lock "cinder-50054aa4-1d44-477f-a010-e91fe7d5773e-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb3d83-44ee-4982-b383-c3afda5a2b56]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:06 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 Apr 28 16:16:06 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:07 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718560f3-8f84-4524-8997-f92c0954862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea10b00-6563-4a36-bebb-c083c569bce4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8ff9ee-48bb-4518-a816-3d0cae85c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Volume volume-7ea10b00-6563-4a36-bebb-c083c569bce4 (7ea10b00-6563-4a36-bebb-c083c569bce4): created successfully Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8ff9ee-48bb-4518-a816-3d0cae85c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Flow 'volume_create_manager' (7ffd1434-2e3a-4982-8dca-421f2b9cc512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a50372d9-2cce-4f10-bbc2-a8c0ac18c7a9 tempest-VolumesTransfersV355Test-487646114 None] Created volume successfully. Apr 28 16:16:07 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" returned: 0 in 0.827s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:07 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2 Apr 28 16:16:07 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:08 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" returned: 0 in 0.654s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-quobyte-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2" released by "delete_volume" :: held 1.555s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Created reservations ['d5e9db20-390d-4e46-9240-212ecab914a6', '7e221810-af49-4ea6-8270-3078eb805977', 'eaae6a77-00b2-4639-b280-78de5e5e0491', '8fcb470a-e73c-4309-8b93-cbd18dfbfc00'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:08 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:08 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "cinder-7ea10b00-6563-4a36-bebb-c083c569bce4-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-7ea10b00-6563-4a36-bebb-c083c569bce4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "cinder-quobyte-7ea10b00-6563-4a36-bebb-c083c569bce4" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-quobyte-7ea10b00-6563-4a36-bebb-c083c569bce4" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[53153f31-91b0-440c-b642-b31b90fdd97d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:09 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 Apr 28 16:16:09 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:09 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.057s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:09 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Deleted volume successfully. Apr 28 16:16:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8fad0342-6804-4b8d-84bf-7c63ad5aef91 tempest-SnapshotsActionsTest-1731632724 None] Lock "cinder-37988c3b-c5b0-4c54-a2b3-14ecccc4f4a2-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:10 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4" returned: 0 in 0.985s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:10 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4 Apr 28 16:16:10 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:10 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ea10b00-6563-4a36-bebb-c083c569bce4" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-quobyte-7ea10b00-6563-4a36-bebb-c083c569bce4" released by "delete_volume" :: held 1.798s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:10 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Created reservations ['6e249909-04a6-4b8d-b154-47b0af6c3d95', '82cb2db3-d37d-4ba7-a91c-fd6bf4b77151', 'bbd4f00a-70a9-4916-b85d-2a53816a8d2d', 'd25f9f27-806a-4872-8b57-249e3bd5b29e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:11 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:11 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:11 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.847s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:11 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Deleted volume successfully. Apr 28 16:16:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a59d61d3-8836-4449-b195-cf3ce815125a tempest-VolumesTransfersV355Test-1122863716 None] Lock "cinder-7ea10b00-6563-4a36-bebb-c083c569bce4-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Flow 'volume_create_manager' (d3456896-04dd-4586-b32e-27a66feb6a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c9cfe0-85a4-49e3-a9f9-2933c619e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c9cfe0-85a4-49e3-a9f9-2933c619e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1682723207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e500648f8da34d8c8d1f646c7caf3868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:19Z,use_quota=True,user_id='224578442fd54a299c33de5018134c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c3948-29c0-4b68-bc7f-58d497437dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c3948-29c0-4b68-bc7f-58d497437dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d642cec5-47d6-4794-b980-8384f3f9df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d642cec5-47d6-4794-b980-8384f3f9df67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4', 'volume_name': 'volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d292c4ba-892b-4e72-af87-64df5eab69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d292c4ba-892b-4e72-af87-64df5eab69ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842deea9-fc2b-47e3-9dda-162df9dcb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:18 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Volume df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4', 'volume_size': 1} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1682723207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e500648f8da34d8c8d1f646c7caf3868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:19Z,use_quota=True,user_id='224578442fd54a299c33de5018134c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Creating volume df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:18 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:18 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 1073741824 Apr 28 16:16:18 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:19 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 1073741824" returned: 0 in 1.151s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:20 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 Apr 28 16:16:20 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:21 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" returned: 0 in 1.007s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842deea9-fc2b-47e3-9dda-162df9dcb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d580b88-f103-44e0-913d-01c356770aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Volume volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 (df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4): created successfully Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d580b88-f103-44e0-913d-01c356770aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Flow 'volume_create_manager' (d3456896-04dd-4586-b32e-27a66feb6a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d99cadfe-38cf-49cf-bbd0-d42907670a83 tempest-SnapshotMetadataTestJSON-505000438 None] Created volume successfully. Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (05c43d59-2c5a-46ca-9d16-81297501d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f3e4f7-7a5e-4b41-a3e3-2a60c243c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f3e4f7-7a5e-4b41-a3e3-2a60c243c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1284352716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:22Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f343d91-5c73-42e4-94e7-731e422acf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f343d91-5c73-42e4-94e7-731e422acf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a04bde-93f2-4906-bcc3-c1635d8e997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a04bde-93f2-4906-bcc3-c1635d8e997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4', 'volume_name': 'volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1d736f-b707-4a47-ab12-5cf96d0b35a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1d736f-b707-4a47-ab12-5cf96d0b35a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98585e0d-180a-41db-92fd-ae76676bdba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:21 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume 146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4', 'volume_size': 1} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1284352716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:22Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating volume 146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:21 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:21 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 1073741824 Apr 28 16:16:21 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:22 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 1073741824" returned: 0 in 0.924s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:22 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 Apr 28 16:16:22 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:23 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" returned: 0 in 0.638s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.332s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Creating offline snapshot c10f3162-b2b5-4a13-b391-b0540ffb61c3 of volume df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98585e0d-180a-41db-92fd-ae76676bdba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0205f1e-cca6-43ef-8c44-5345060d7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9868393c-8e7d-414f-956e-07db41a14798]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 (146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4): created successfully Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0205f1e-cca6-43ef-8c44-5345060d7a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (05c43d59-2c5a-46ca-9d16-81297501d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0fb27592-6895-4f1f-8371-16c64c2af683 tempest-VolumesSnapshotTestJSON-1255076549 None] Created volume successfully. Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Flow 'volume_create_manager' (6ac79b7d-5304-466e-aa43-1b9772cd0e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c22b77a-94b9-4f3c-af4c-0a768d751e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c22b77a-94b9-4f3c-af4c-0a768d751e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-725725276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dd07bd-51a4-4a28-a90a-d061940512ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1637f038d55646f0a5b657da730efdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:24Z,use_quota=True,user_id='1623fbb67909415688fb4cae6b01636f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e80dd5e-3e6e-4306-a9db-74e13d5efc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e80dd5e-3e6e-4306-a9db-74e13d5efc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 Apr 28 16:16:23 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e53c668-b9ad-4edf-8cb4-ef034b899f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e53c668-b9ad-4edf-8cb4-ef034b899f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dd07bd-51a4-4a28-a90a-d061940512ae', 'volume_name': 'volume-c2dd07bd-51a4-4a28-a90a-d061940512ae', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016bf8cd-e5d9-478d-acab-3519e0d66cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016bf8cd-e5d9-478d-acab-3519e0d66cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf313ec-ba5f-46cd-94d9-c5abc79df8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Volume c2dd07bd-51a4-4a28-a90a-d061940512ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dd07bd-51a4-4a28-a90a-d061940512ae', 'volume_size': 1} Apr 28 16:16:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:24 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" returned: 0 in 0.960s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:24 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 1G Apr 28 16:16:24 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:25 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 1G" returned: 0 in 0.765s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:25 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 Apr 28 16:16:25 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:25 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3" returned: 0 in 0.624s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:25 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 is being set with open permissions: ugo+rw Apr 28 16:16:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:25 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 Apr 28 16:16:25 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:26 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:26 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info Apr 28 16:16:26 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:27 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info" returned: 0 in 0.643s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:27 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info is being set with open permissions: ugo+rw Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:27 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info Apr 28 16:16:27 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:27 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.info" returned: 0 in 0.618s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.049s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-725725276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dd07bd-51a4-4a28-a90a-d061940512ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1637f038d55646f0a5b657da730efdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:24Z,use_quota=True,user_id='1623fbb67909415688fb4cae6b01636f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Creating volume c2dd07bd-51a4-4a28-a90a-d061940512ae {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:27 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:27 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae 1073741824 Apr 28 16:16:27 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-60c28147-6fe4-43e4-a565-c9f3cd5d2837 tempest-SnapshotMetadataTestJSON-505000438 None] Create snapshot completed successfully Apr 28 16:16:28 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae 1073741824" returned: 0 in 0.932s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:28 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae Apr 28 16:16:28 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "cinder-c10f3162-b2b5-4a13-b391-b0540ffb61c3-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-c10f3162-b2b5-4a13-b391-b0540ffb61c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "cinder-quobyte-c10f3162-b2b5-4a13-b391-b0540ffb61c3" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-c10f3162-b2b5-4a13-b391-b0540ffb61c3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Deleting offline snapshot c10f3162-b2b5-4a13-b391-b0540ffb61c3 of volume df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] snapshot_file for this snap is: volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[22868dee-73ea-4c61-b869-c938f942bb53]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:29 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 Apr 28 16:16:29 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:29 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae" returned: 0 in 0.694s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.326s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf313ec-ba5f-46cd-94d9-c5abc79df8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dd07bd-51a4-4a28-a90a-d061940512ae', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a59e39-a89a-46c4-a8e7-5d89e4b6e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Creating offline snapshot 335eaf51-ec2e-4709-a53e-ab4f4c41b001 of volume 146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:16:29 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Volume volume-c2dd07bd-51a4-4a28-a90a-d061940512ae (c2dd07bd-51a4-4a28-a90a-d061940512ae): created successfully Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a59e39-a89a-46c4-a8e7-5d89e4b6e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Flow 'volume_create_manager' (6ac79b7d-5304-466e-aa43-1b9772cd0e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbdf2a8-0e7f-4973-ba10-fa9d36a88014]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-73347b90-a61c-4c8a-a48b-c867775a50f7 tempest-VolumesTransfersV357Test-992462053 None] Created volume successfully. Apr 28 16:16:29 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 Apr 28 16:16:29 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:30 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3" returned: 0 in 0.824s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd711a2-8ec2-424a-b33c-412a1be5bdfc]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:30 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 Apr 28 16:16:30 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:30 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" returned: 0 in 0.900s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:30 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 1G Apr 28 16:16:30 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d77a88c8-5a48-4b5a-bfe1-a9e20e93a6c7 tempest-VolumesTransfersV357Test-425086005 None] Transfer volume completed successfully. Apr 28 16:16:31 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" returned: 0 in 0.835s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:31 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 Apr 28 16:16:31 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:31 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 1G" returned: 0 in 0.862s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:31 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 Apr 28 16:16:31 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:31 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3" returned: 0 in 0.860s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:31 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3 Apr 28 16:16:31 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "cinder-c2dd07bd-51a4-4a28-a90a-d061940512ae-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-c2dd07bd-51a4-4a28-a90a-d061940512ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:32 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001" returned: 0 in 0.788s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:32 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 is being set with open permissions: ugo+rw Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:32 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 Apr 28 16:16:32 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "cinder-quobyte-c2dd07bd-51a4-4a28-a90a-d061940512ae" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-quobyte-c2dd07bd-51a4-4a28-a90a-d061940512ae" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e64d04-5f84-407c-99a5-bd5edf4ed3f1]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:32 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae Apr 28 16:16:32 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:32 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4.c10f3162-b2b5-4a13-b391-b0540ffb61c3" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Flow 'volume_create_manager' (93ca0193-56da-4afa-88b9-b6c38f40c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d988e6a1-9e52-49aa-9167-d1bfff40a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d988e6a1-9e52-49aa-9167-d1bfff40a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1970054121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f012f2de2fcd4924b76b64ab786a9ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:33Z,use_quota=True,user_id='2be386b5d8e34a649f6f4147f984134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283c5b8d-a945-4194-83c5-24be7764e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283c5b8d-a945-4194-83c5-24be7764e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145b3c2d-75aa-459b-a9f9-78f07cb2fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145b3c2d-75aa-459b-a9f9-78f07cb2fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb', 'volume_name': 'volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdaaf05-38c8-4156-baaf-81bb6612ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdaaf05-38c8-4156-baaf-81bb6612ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f25816-f3ab-4227-bc2f-a55ce287266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:32 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Volume 52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb', 'volume_size': 1} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-c10f3162-b2b5-4a13-b391-b0540ffb61c3" released by "_delete_snapshot" :: held 3.472s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" released by "delete_snapshot" :: held 3.507s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:32 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Created reservations ['7eebf146-8c42-4f81-b56c-c709e5954d7a', '44ef2105-27ac-43bb-b585-807e78a4d0a6', '83c17ffb-1846-4596-8ef3-1f99385b3ef4', 'fc2e1e24-8c2b-4dfc-a603-d90a6d12bd48'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:32 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info Apr 28 16:16:32 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:32 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Delete snapshot completed successfully. Apr 28 16:16:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-cb89e879-2556-4284-9153-6058bce0e606 tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-c10f3162-b2b5-4a13-b391-b0540ffb61c3-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:33 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae" returned: 0 in 0.865s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:33 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae Apr 28 16:16:33 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:33 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "cinder-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info" returned: 0 in 0.679s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info is being set with open permissions: ugo+rw Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:33 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info Apr 28 16:16:33 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeca8d9-38b9-456e-8927-1593a2386443]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:33 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-c2dd07bd-51a4-4a28-a90a-d061940512ae" returned: 0 in 0.681s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-quobyte-c2dd07bd-51a4-4a28-a90a-d061940512ae" released by "delete_volume" :: held 1.593s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:33 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 Apr 28 16:16:33 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Created reservations ['2ec15e77-556c-48c5-b9fd-3fb781dda81e', '4d4d9ffd-55cb-46e4-9a2c-6b1f3d4d255b', 'c2cdc47e-c63a-4efc-a800-977a96105a68', 'becbc01d-067e-4b06-864e-5917cb86504f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:33 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:33 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:34 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.info" returned: 0 in 0.694s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.784s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1970054121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f012f2de2fcd4924b76b64ab786a9ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:33Z,use_quota=True,user_id='2be386b5d8e34a649f6f4147f984134c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Creating volume 52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:34 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:34 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb 1073741824 Apr 28 16:16:34 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-af897b65-822a-43ce-a174-57fcc878325e tempest-VolumesSnapshotTestJSON-1255076549 None] Create snapshot completed successfully Apr 28 16:16:34 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" returned: 0 in 0.831s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:34 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.647s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:34 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4 Apr 28 16:16:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Deleted volume successfully. Apr 28 16:16:34 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d21dbc0e-9e14-4cc7-ada1-33b53532168a tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-c2dd07bd-51a4-4a28-a90a-d061940512ae-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Flow 'volume_create_manager' (bfb008a4-557f-4c73-9535-5e0552852a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c4e863-fb48-481c-9aba-c8db2d376313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-335eaf51-ec2e-4709-a53e-ab4f4c41b001-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c4e863-fb48-481c-9aba-c8db2d376313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2025649179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21fb6a-7f7f-475c-be1b-47e4b4677c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1637f038d55646f0a5b657da730efdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:35Z,use_quota=True,user_id='1623fbb67909415688fb4cae6b01636f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573761e1-bac3-4102-ba87-5f2d93893769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573761e1-bac3-4102-ba87-5f2d93893769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adae7cdd-dbe0-4f84-8245-2f79bb52e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adae7cdd-dbe0-4f84-8245-2f79bb52e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b21fb6a-7f7f-475c-be1b-47e4b4677c09', 'volume_name': 'volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9c027-f39b-4327-b681-86910ec95b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c9c027-f39b-4327-b681-86910ec95b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6883f9f5-0766-4b9a-bee1-25e0e3dff2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:34 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Volume 6b21fb6a-7f7f-475c-be1b-47e4b4677c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09', 'volume_size': 1} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-335eaf51-ec2e-4709-a53e-ab4f4c41b001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-335eaf51-ec2e-4709-a53e-ab4f4c41b001" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-335eaf51-ec2e-4709-a53e-ab4f4c41b001" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleting offline snapshot 335eaf51-ec2e-4709-a53e-ab4f4c41b001 of volume 146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] snapshot_file for this snap is: volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9f57e-dce1-4389-8be1-5182ce6ef078]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:35 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 Apr 28 16:16:35 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:35 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" returned: 0 in 0.810s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-quobyte-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4" released by "delete_volume" :: held 1.714s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Created reservations ['0e4b6c44-dbc6-4761-bb42-e14cf5e8afef', 'b0a3a597-ef7f-4e64-9d2f-5be6dbcf38d8', '45e570d2-251f-4d00-a649-87e1c8ead77b', '2864a599-ac13-47f8-8b0c-4f5a11a95b1a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:35 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb 1073741824" returned: 0 in 1.141s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:35 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:35 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:35 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb Apr 28 16:16:35 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:35 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001" returned: 0 in 0.895s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:16:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd748b44-4b1f-4ae3-a5c0-d738175bbc25]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:36 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 Apr 28 16:16:36 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:36 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" returned: 0 in 0.717s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:36 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2025649179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21fb6a-7f7f-475c-be1b-47e4b4677c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1637f038d55646f0a5b657da730efdbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:35Z,use_quota=True,user_id='1623fbb67909415688fb4cae6b01636f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Creating volume 6b21fb6a-7f7f-475c-be1b-47e4b4677c09 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:36 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.776s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Deleted volume successfully. Apr 28 16:16:36 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 1073741824 Apr 28 16:16:36 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f25816-f3ab-4227-bc2f-a55ce287266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144e993a-356b-4491-8e85-2feb1d74cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Volume volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb (52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb): created successfully Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144e993a-356b-4491-8e85-2feb1d74cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Flow 'volume_create_manager' (93ca0193-56da-4afa-88b9-b6c38f40c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8965b15c-0b86-4a1a-bd6f-5a7a192df01b tempest-SnapshotMetadataTestJSON-505000438 None] Lock "cinder-df0f6a90-139c-4f50-a3fa-d5bdb5fb29c4-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4a301d33-c853-47ad-8962-69fa3af7ca00 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Created volume successfully. Apr 28 16:16:36 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" returned: 0 in 0.846s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:36 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 Apr 28 16:16:36 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:37 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 1073741824" returned: 0 in 0.973s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:37 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 Apr 28 16:16:37 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:37 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001" returned: 0 in 0.881s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:37 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001 Apr 28 16:16:37 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:37 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" returned: 0 in 0.690s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6883f9f5-0766-4b9a-bee1-25e0e3dff2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fa62a9-e04c-4b15-b253-327b4f3b088c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Volume volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 (6b21fb6a-7f7f-475c-be1b-47e4b4677c09): created successfully Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fa62a9-e04c-4b15-b253-327b4f3b088c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Flow 'volume_create_manager' (bfb008a4-557f-4c73-9535-5e0552852a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f1def95e-d1cb-4c8f-a771-088bba990524 tempest-VolumesTransfersV357Test-992462053 None] Created volume successfully. Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Acquiring lock "cinder-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "cinder-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Acquiring lock "cinder-quobyte-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "cinder-quobyte-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ae894a-065b-4eaa-b47a-dc9defd16045]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:38 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb Apr 28 16:16:38 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:38 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4.335eaf51-ec2e-4709-a53e-ab4f4c41b001" returned: 0 in 0.717s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-335eaf51-ec2e-4709-a53e-ab4f4c41b001" released by "_delete_snapshot" :: held 3.477s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" released by "delete_snapshot" :: held 3.504s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['9b674e21-7b83-46ca-9ae2-3d09be0a5244', '89124eae-1204-43df-9323-732d39068078', 'ace31b43-f044-46e7-86df-d751cb27ef12', '6bdad5e3-e1f9-44c5-b255-131120ea1e33'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Delete snapshot completed successfully. Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-427b1505-48f3-40b4-8b67-2affea6ad840 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-335eaf51-ec2e-4709-a53e-ab4f4c41b001-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:38 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Flow 'volume_create_manager' (e022f58f-058a-4ca8-9401-50905b5c12ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33079050-b421-4cc5-a323-2648a47d1cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" returned: 0 in 0.775s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:38 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb Apr 28 16:16:38 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33079050-b421-4cc5-a323-2648a47d1cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745662916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605de6b3-cc9a-4741-9a19-cd81aa4dad59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f328c79568ec4c00b101679e58a9afcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:39Z,use_quota=True,user_id='49b704e97af24a09a56cfa7c633326b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd47885-1843-474f-b969-8a2f7483afe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd47885-1843-474f-b969-8a2f7483afe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9574d6f0-194d-4030-8282-35f5be2d9efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9574d6f0-194d-4030-8282-35f5be2d9efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605de6b3-cc9a-4741-9a19-cd81aa4dad59', 'volume_name': 'volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e14b96-4b46-4527-9648-834ff29d8fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e14b96-4b46-4527-9648-834ff29d8fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78e44a-e0e8-4779-b62c-1e67961a5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Volume 605de6b3-cc9a-4741-9a19-cd81aa4dad59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59', 'volume_size': 1} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745662916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605de6b3-cc9a-4741-9a19-cd81aa4dad59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f328c79568ec4c00b101679e58a9afcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:39Z,use_quota=True,user_id='49b704e97af24a09a56cfa7c633326b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Creating volume 605de6b3-cc9a-4741-9a19-cd81aa4dad59 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:39 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:39 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 1073741824 Apr 28 16:16:39 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "cinder-6b21fb6a-7f7f-475c-be1b-47e4b4677c09-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-6b21fb6a-7f7f-475c-be1b-47e4b4677c09-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "cinder-quobyte-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (a2ad7410-5474-4231-8a46-13cde1d12ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74c0bb5-6a7f-4304-84b6-373bb4073551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-quobyte-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" acquired by "delete_volume" :: waited 0.050s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74c0bb5-6a7f-4304-84b6-373bb4073551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1287328438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:40Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93135555-a77e-4bb2-be11-91654ad6c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93135555-a77e-4bb2-be11-91654ad6c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38113e1-5367-4f20-8e38-7a7440d393f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38113e1-5367-4f20-8e38-7a7440d393f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed', 'volume_name': 'volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f23a1e-27a0-41fa-bc01-7b4769fd4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f23a1e-27a0-41fa-bc01-7b4769fd4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8b277a-5b4a-4c00-8334-f6a6ffcd269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume 1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed', 'volume_size': 1} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731b4d7-b3c9-4071-991e-fa474ef4e4f2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" returned: 0 in 0.841s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "cinder-quobyte-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb" released by "delete_volume" :: held 1.674s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Created reservations ['ff3a4146-11ac-415c-b125-540044a483ef', '06a04d4b-32fa-4f9c-8dcf-8a48085790d9', 'ccc7f0d8-1456-4651-b43c-1efa57eb0946', '8a0dc543-e970-41ef-8972-6be7932b1502'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:39 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 Apr 28 16:16:39 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:39 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:39 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:40 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 1073741824" returned: 0 in 0.972s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:40 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 Apr 28 16:16:40 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:40 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" returned: 0 in 0.779s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:40 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.671s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:40 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09 Apr 28 16:16:40 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Deleted volume successfully. Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-04322d8f-52d6-4478-8b1b-177308921417 tempest-VolumeQuotasNegativeTestJSON-1073287351 None] Lock "cinder-52d2aa3a-b602-4d61-8a71-90e6fb8a9dcb-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:40 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59" returned: 0 in 0.660s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1287328438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:40Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating volume 1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:40 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d78e44a-e0e8-4779-b62c-1e67961a5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8c5d51-911e-4477-bd05-78a6c2999082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:40 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed 1073741824 Apr 28 16:16:40 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Volume volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 (605de6b3-cc9a-4741-9a19-cd81aa4dad59): created successfully Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8c5d51-911e-4477-bd05-78a6c2999082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Flow 'volume_create_manager' (e022f58f-058a-4ca8-9401-50905b5c12ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d8b9b2e8-8d7c-410e-b968-d494e490638a tempest-VolumesMetadataTest-1124181412 None] Created volume successfully. Apr 28 16:16:41 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" returned: 0 in 0.692s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-quobyte-6b21fb6a-7f7f-475c-be1b-47e4b4677c09" released by "delete_volume" :: held 1.561s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Created reservations ['14d7b7f2-c0a7-4fd9-8f01-c7faa3457f0a', '726ed1d7-f641-42ed-b247-ffa981d3f2d2', '924e2573-7ec6-457c-872a-255c06c455fb', 'f5b1cc60-883c-45c6-ae4b-78b774913fc3'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:41 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:41 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:41 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed 1073741824" returned: 0 in 1.131s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:41 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:16:41 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Acquiring lock "cinder-605de6b3-cc9a-4741-9a19-cd81aa4dad59-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "cinder-605de6b3-cc9a-4741-9a19-cd81aa4dad59-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Acquiring lock "cinder-quobyte-605de6b3-cc9a-4741-9a19-cd81aa4dad59" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "cinder-quobyte-605de6b3-cc9a-4741-9a19-cd81aa4dad59" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:42 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.834s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b553f3-87e6-4983-b61a-c9872f7285c9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Deleted volume successfully. Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-da79949e-36ae-4a9b-b8fa-1ab630b732a4 tempest-VolumesTransfersV357Test-17100285 None] Lock "cinder-6b21fb6a-7f7f-475c-be1b-47e4b4677c09-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:42 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 Apr 28 16:16:42 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:42 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8b277a-5b4a-4c00-8334-f6a6ffcd269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4e65c7-192f-45ee-8650-35ec1adad640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:42 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed (1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed): created successfully Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4e65c7-192f-45ee-8650-35ec1adad640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (a2ad7410-5474-4231-8a46-13cde1d12ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ac9d20e9-69a1-4894-a8a4-e4af696936c9 tempest-VolumesSnapshotTestJSON-1255076549 None] Created volume successfully. Apr 28 16:16:43 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59" returned: 0 in 0.889s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:43 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59 Apr 28 16:16:43 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:43 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-605de6b3-cc9a-4741-9a19-cd81aa4dad59" returned: 0 in 0.669s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "cinder-quobyte-605de6b3-cc9a-4741-9a19-cd81aa4dad59" released by "delete_volume" :: held 1.626s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Created reservations ['ca273fc0-06ac-4519-9a45-edd566e05154', 'daca13ee-98d5-4074-97c9-2f66091ea6f8', '3349652a-6a06-487a-9b52-89faa26adfcf', '40753fde-b9e1-41f6-a3f5-32cfabdc331f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:44 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:44 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating offline snapshot 5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc of volume 1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8301730a-6476-4efa-a4a6-9853962607a7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:44 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:16:44 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:44 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.843s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Deleted volume successfully. Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=135,cinder:INSERT=41,cinder:UPDATE=166,cinder:DELETE=11 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:16:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9947ea26-bf45-4c04-a50e-1167c42c9c15 tempest-VolumesMetadataTest-1124181412 None] Lock "cinder-605de6b3-cc9a-4741-9a19-cd81aa4dad59-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:45 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 1.120s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:45 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc 1G Apr 28 16:16:45 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:46 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc 1G" returned: 0 in 1.078s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:46 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:16:46 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:47 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.712s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:47 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc is being set with open permissions: ugo+rw Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:47 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:16:47 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=128,cinder:INSERT=41,cinder:UPDATE=159,cinder:DELETE=16 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Flow 'volume_create_manager' (319091c8-c6ce-4465-96ab-58ff609d3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed06eae-4fbf-40dc-90a0-61865b00e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed06eae-4fbf-40dc-90a0-61865b00e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268485732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce365ac0-048f-4c51-bd68-756735cd4785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394ccb810c0740d1a7c358d00ffe60c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:48Z,use_quota=True,user_id='a3030d74db8e4b9d9a662d55bf6324dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795c535d-2b0b-43a5-9829-d7972aba74ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795c535d-2b0b-43a5-9829-d7972aba74ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444872a7-d5db-42a6-b6fb-bb52d96d033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444872a7-d5db-42a6-b6fb-bb52d96d033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce365ac0-048f-4c51-bd68-756735cd4785', 'volume_name': 'volume-ce365ac0-048f-4c51-bd68-756735cd4785', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bbfa94-8308-43a2-a960-1ba0f6084ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4bbfa94-8308-43a2-a960-1ba0f6084ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3cd1bc-b08e-4d35-89a9-7e9e1137983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:47 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Volume ce365ac0-048f-4c51-bd68-756735cd4785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce365ac0-048f-4c51-bd68-756735cd4785', 'volume_size': 1} Apr 28 16:16:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:48 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.747s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:48 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info Apr 28 16:16:48 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Flow 'volume_create_manager' (9f26f597-32b6-4257-a71e-ddc743a876cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d21a7a7-9cef-46b7-ad13-6761da10fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d21a7a7-9cef-46b7-ad13-6761da10fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-728248045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3359629b-7830-4816-92da-384c9bb6dc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e29043b7214c8cb30f21e533441fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:48Z,use_quota=True,user_id='fa77f856e5bb460fb464bce235657b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8587aeb6-1266-408a-987f-86560b525e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8587aeb6-1266-408a-987f-86560b525e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebefe45-10ca-4845-985e-2399abffff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebefe45-10ca-4845-985e-2399abffff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3359629b-7830-4816-92da-384c9bb6dc78', 'volume_name': 'volume-3359629b-7830-4816-92da-384c9bb6dc78', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fad70e-cb2e-4871-b053-a438614cee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fad70e-cb2e-4871-b053-a438614cee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48368a4-0c64-4410-a332-06be63117f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:48 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Volume 3359629b-7830-4816-92da-384c9bb6dc78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3359629b-7830-4816-92da-384c9bb6dc78', 'volume_size': 1} Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:48 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info" returned: 0 in 0.666s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:48 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info is being set with open permissions: ugo+rw Apr 28 16:16:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:48 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info Apr 28 16:16:48 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:49 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.info" returned: 0 in 0.592s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.047s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268485732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce365ac0-048f-4c51-bd68-756735cd4785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394ccb810c0740d1a7c358d00ffe60c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:48Z,use_quota=True,user_id='a3030d74db8e4b9d9a662d55bf6324dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Creating volume ce365ac0-048f-4c51-bd68-756735cd4785 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:49 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:49 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 1073741824 Apr 28 16:16:49 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e5f78f83-bf45-4289-8de9-7a483029b461 tempest-VolumesSnapshotTestJSON-1255076549 None] Create snapshot completed successfully Apr 28 16:16:49 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Flow 'volume_create_manager' (de660de9-92c2-4af2-9b2c-994ac03f2a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e27312-4f85-40ed-b1e7-87bbdb7be549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e27312-4f85-40ed-b1e7-87bbdb7be549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-432345183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787152f4-e392-4c38-b015-008cb738987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cdf4ba9d334935bc55b5226ebe1138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:50Z,use_quota=True,user_id='23c948ce36d4423e921b90c39c809aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d2ccb-4fba-46cd-9044-704b7931abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d2ccb-4fba-46cd-9044-704b7931abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c2aa7d-f52b-418d-8a86-69558da2fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c2aa7d-f52b-418d-8a86-69558da2fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787152f4-e392-4c38-b015-008cb738987a', 'volume_name': 'volume-787152f4-e392-4c38-b015-008cb738987a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af81c1-8649-4487-8238-bdfb5a767963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83af81c1-8649-4487-8238-bdfb5a767963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24948603-1506-4ca7-bb24-907726fdcfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Volume 787152f4-e392-4c38-b015-008cb738987a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787152f4-e392-4c38-b015-008cb738987a', 'volume_size': 1} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (08c5eb37-ae87-49b3-8720-a8c484e5d1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393d756-7f40-4a00-a3b0-1e0d335b4002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7393d756-7f40-4a00-a3b0-1e0d335b4002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1509395839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fb0486-2260-4961-a05a-870919d72f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:50Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42712ea4-a73a-4253-9a56-e5d21f74d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42712ea4-a73a-4253-9a56-e5d21f74d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd67f5a-fa27-4cac-ab8d-2e2198ef2198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd67f5a-fa27-4cac-ab8d-2e2198ef2198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09fb0486-2260-4961-a05a-870919d72f26', 'volume_name': 'volume-09fb0486-2260-4961-a05a-870919d72f26', 'volume_size': 2, 'snapshot_id': '5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9b69f1-37cb-4530-8704-3a784a5d6b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9b69f1-37cb-4530-8704-3a784a5d6b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3785b7b1-3f85-4a32-a764-7f418832628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Volume 09fb0486-2260-4961-a05a-870919d72f26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09fb0486-2260-4961-a05a-870919d72f26', 'volume_size': 2, 'snapshot_id': '5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc'} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:50 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 1073741824" returned: 0 in 0.862s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:50 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 Apr 28 16:16:50 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:50 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785" returned: 0 in 0.573s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-728248045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3359629b-7830-4816-92da-384c9bb6dc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e29043b7214c8cb30f21e533441fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:48Z,use_quota=True,user_id='fa77f856e5bb460fb464bce235657b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Creating volume 3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:50 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:50 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 1073741824 Apr 28 16:16:50 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3cd1bc-b08e-4d35-89a9-7e9e1137983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce365ac0-048f-4c51-bd68-756735cd4785', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ddf665-5d12-444f-a43c-419b2ada7298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:50 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Volume volume-ce365ac0-048f-4c51-bd68-756735cd4785 (ce365ac0-048f-4c51-bd68-756735cd4785): created successfully Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ddf665-5d12-444f-a43c-419b2ada7298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:50 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Flow 'volume_create_manager' (319091c8-c6ce-4465-96ab-58ff609d3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:50 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-65d07ff2-63a6-4187-8565-2cca9b8229e7 tempest-VolumesServicesTestJSON-1495587151 None] Created volume successfully. Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Acquiring lock "cinder-ce365ac0-048f-4c51-bd68-756735cd4785-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "cinder-ce365ac0-048f-4c51-bd68-756735cd4785-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Acquiring lock "cinder-quobyte-ce365ac0-048f-4c51-bd68-756735cd4785" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "cinder-quobyte-ce365ac0-048f-4c51-bd68-756735cd4785" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0110df-c3e6-44c9-b111-7a6bb9542b98]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:51 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 Apr 28 16:16:51 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:51 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 1073741824" returned: 0 in 0.756s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:51 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:16:51 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:52 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785" returned: 0 in 0.736s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:52 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785 Apr 28 16:16:52 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:52 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.574s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-432345183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787152f4-e392-4c38-b015-008cb738987a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cdf4ba9d334935bc55b5226ebe1138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:50Z,use_quota=True,user_id='23c948ce36d4423e921b90c39c809aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Creating volume 787152f4-e392-4c38-b015-008cb738987a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:52 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:52 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a 1073741824 Apr 28 16:16:52 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48368a4-0c64-4410-a332-06be63117f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3359629b-7830-4816-92da-384c9bb6dc78', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa01b86-2094-42d3-9698-d70b0093c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:52 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Volume volume-3359629b-7830-4816-92da-384c9bb6dc78 (3359629b-7830-4816-92da-384c9bb6dc78): created successfully Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa01b86-2094-42d3-9698-d70b0093c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Flow 'volume_create_manager' (9f26f597-32b6-4257-a71e-ddc743a876cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:52 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ea87a085-52da-49cc-9d9c-c21e1e367066 tempest-VolumesCloneTest-197891108 None] Created volume successfully. Apr 28 16:16:52 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ce365ac0-048f-4c51-bd68-756735cd4785" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "cinder-quobyte-ce365ac0-048f-4c51-bd68-756735cd4785" released by "delete_volume" :: held 1.390s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Created reservations ['175a874c-aaa8-4655-bcce-7e34df84c0f1', '6c09c74a-6d07-4810-b31e-da2702bbbd3a', '9af04998-6d9c-46f6-8518-7b3a6cc7565b', '5fdb5045-3af5-4d5e-a233-24599f5e972d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:52 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:16:52 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:53 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a 1073741824" returned: 0 in 0.885s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:16:53 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a Apr 28 16:16:53 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Flow 'volume_create_manager' (7cac62af-a161-40d6-a761-675866e66649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa565a2e-e6c8-423f-82f1-5a58ba7cb7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa565a2e-e6c8-423f-82f1-5a58ba7cb7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1734307202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f28cda-5bbf-4aaa-a732-700029483654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e29043b7214c8cb30f21e533441fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:16:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3359629b-7830-4816-92da-384c9bb6dc78,status='creating',terminated_at=None,updated_at=2026-04-28T14:16:53Z,use_quota=True,user_id='fa77f856e5bb460fb464bce235657b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c422b3-b43c-4f1c-bd44-c25011d58039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c422b3-b43c-4f1c-bd44-c25011d58039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca884653-c07b-4796-b465-df2e55b92f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca884653-c07b-4796-b465-df2e55b92f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '63f28cda-5bbf-4aaa-a732-700029483654', 'volume_name': 'volume-63f28cda-5bbf-4aaa-a732-700029483654', 'volume_size': 2, 'source_volid': '3359629b-7830-4816-92da-384c9bb6dc78', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0418c62-a107-472b-a548-ae32c04c7e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0418c62-a107-472b-a548-ae32c04c7e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488b16b-ae65-40be-9502-3ad654a93d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Volume 63f28cda-5bbf-4aaa-a732-700029483654: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-63f28cda-5bbf-4aaa-a732-700029483654', 'volume_size': 2, 'source_volid': '3359629b-7830-4816-92da-384c9bb6dc78', 'source_volstatus': 'available'} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:53 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.714s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:16:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Deleted volume successfully. Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1bdc089f-5f59-403c-9484-759682f05080 tempest-VolumesServicesTestJSON-1495587151 None] Lock "cinder-ce365ac0-048f-4c51-bd68-756735cd4785-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:53 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a" returned: 0 in 0.612s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.617s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-09fb0486-2260-4961-a05a-870919d72f26" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24948603-1506-4ca7-bb24-907726fdcfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787152f4-e392-4c38-b015-008cb738987a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36586bc-8083-44e5-92e9-9ca896ab2a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-09fb0486-2260-4961-a05a-870919d72f26" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Creating volume 09fb0486-2260-4961-a05a-870919d72f26 from snapshot 5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:53 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Volume volume-787152f4-e392-4c38-b015-008cb738987a (787152f4-e392-4c38-b015-008cb738987a): created successfully Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36586bc-8083-44e5-92e9-9ca896ab2a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Flow 'volume_create_manager' (de660de9-92c2-4af2-9b2c-994ac03f2a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] snapshot: 5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc, volume: 09fb0486-2260-4961-a05a-870919d72f26, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:16:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-77049d56-9eb3-4a3f-92fd-350559a24caf tempest-VolumesTransfersTest-4762675 None] Created volume successfully. Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833dadf-0a00-420e-8029-c36d6af4e529]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:54 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:16:54 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:54 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.797s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[41904946-c214-4f08-8e9e-82b071b935b4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:54 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:16:54 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-44937d50-229f-4799-a5f4-ac9777b44e98 tempest-VolumesTransfersTest-2093183165 None] Transfer volume completed successfully. Apr 28 16:16:55 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 0.827s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:55 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:16:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:55 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 Apr 28 16:16:55 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "cinder-787152f4-e392-4c38-b015-008cb738987a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-787152f4-e392-4c38-b015-008cb738987a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "cinder-quobyte-787152f4-e392-4c38-b015-008cb738987a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-quobyte-787152f4-e392-4c38-b015-008cb738987a" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5e72fe-9b0f-4d2c-9468-8575830bbb79]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:16:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:56 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a Apr 28 16:16:56 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:58 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a" returned: 0 in 1.729s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:16:58 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a Apr 28 16:16:58 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:16:59 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-787152f4-e392-4c38-b015-008cb738987a" returned: 0 in 1.312s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-quobyte-787152f4-e392-4c38-b015-008cb738987a" released by "delete_volume" :: held 3.115s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Created reservations ['5a5451c5-bfa3-49a4-8ddb-91b1bd955aa9', '65a63fc1-6bfe-420c-9390-626605c69320', '7237163b-6efd-4949-9420-330c64f8fe53', '8b9b45e3-4d80-4ff8-8dbb-4c343b5dca68'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:16:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:00 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:00 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:00 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:00 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:00 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Flow 'volume_create_manager' (dfc5e42c-f15e-4492-bc57-baa6bd09efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb493b-5c76-4ad3-8de0-c4f022550181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eeb493b-5c76-4ad3-8de0-c4f022550181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-146227697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cf71c0-941f-4ee7-9307-053bd67bf600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cdf4ba9d334935bc55b5226ebe1138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:01Z,use_quota=True,user_id='23c948ce36d4423e921b90c39c809aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce6f66f-7cf1-4c60-a1ce-c008eda7a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce6f66f-7cf1-4c60-a1ce-c008eda7a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94106024-5b73-404a-8ff2-84cf7dd40801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94106024-5b73-404a-8ff2-84cf7dd40801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cf71c0-941f-4ee7-9307-053bd67bf600', 'volume_name': 'volume-48cf71c0-941f-4ee7-9307-053bd67bf600', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4753b0-5cdc-4a39-9038-4e79137f05f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4753b0-5cdc-4a39-9038-4e79137f05f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0665fb17-011c-48e2-86ca-49f2d3911350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:01 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Volume 48cf71c0-941f-4ee7-9307-053bd67bf600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cf71c0-941f-4ee7-9307-053bd67bf600', 'volume_size': 1} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:01 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.787s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:01 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Deleted volume successfully. Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26" returned: 0 in 6.131s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-25590eef-0966-4d2e-b117-a6cb55a14af3 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-787152f4-e392-4c38-b015-008cb738987a-delete_volume" released by "delete_volume" :: held 5.471s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a03c78-4abc-42c7-b3b3-9b7365136334]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:01 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.196s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:01 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:17:01 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:02 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 0.926s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:02 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:17:02 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Converted 1024.00 MB image at 167.00 MB/s Apr 28 16:17:02 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 is being set with open permissions: ugo+rw Apr 28 16:17:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:02 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 Apr 28 16:17:02 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:03 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26" returned: 0 in 0.695s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" released by "_copy_volume_from_snapshot" :: held 9.509s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-09fb0486-2260-4961-a05a-870919d72f26" released by "_create_volume_from_snapshot" :: held 9.546s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.589s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.075s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:03 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Cloning volume 3359629b-7830-4816-92da-384c9bb6dc78 to volume 63f28cda-5bbf-4aaa-a732-700029483654 Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3785b7b1-3f85-4a32-a764-7f418832628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fb0486-2260-4961-a05a-870919d72f26', 'volume_size': 2, 'snapshot_id': '5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f3df44-1c89-4d59-896f-178f807c667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Creating offline snapshot a8e1cc00-4d7b-469c-88f5-d61005b84bb3 of volume 3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:17:03 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Volume volume-09fb0486-2260-4961-a05a-870919d72f26 (09fb0486-2260-4961-a05a-870919d72f26): created successfully Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f3df44-1c89-4d59-896f-178f807c667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (08c5eb37-ae87-49b3-8720-a8c484e5d1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b835a-b7ea-4a0f-b040-246144ce71b9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-71bb3886-25c6-4595-a6f0-c1de2576eccc tempest-VolumesSnapshotTestJSON-1255076549 None] Created volume successfully. Apr 28 16:17:03 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:03 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:04 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.781s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:04 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 1G Apr 28 16:17:04 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-09fb0486-2260-4961-a05a-870919d72f26-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-09fb0486-2260-4961-a05a-870919d72f26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526d080-4b69-4846-8298-698b40078357]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:04 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 Apr 28 16:17:04 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:05 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 1G" returned: 0 in 0.955s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3359629b-7830-4816-92da-384c9bb6dc78 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:05 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3359629b-7830-4816-92da-384c9bb6dc78 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:05 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:05 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26" returned: 0 in 0.808s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:05 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26 Apr 28 16:17:05 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:05 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3359629b-7830-4816-92da-384c9bb6dc78 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.691s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:05 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 is being set with open permissions: ugo+rw Apr 28 16:17:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:05 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:05 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:06 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-09fb0486-2260-4961-a05a-870919d72f26" returned: 0 in 0.696s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-09fb0486-2260-4961-a05a-870919d72f26" released by "delete_volume" :: held 1.566s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['99e3b2b3-80f8-46fb-9aa8-9cff6d633af3', 'e60f9c37-7c21-4006-904e-339890d8f74d', '7201b0cf-c726-49a3-9dfe-4644aa66046e', '39998136-5f1f-4db3-805a-40be1d618634'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:06 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:06 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:06 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.618s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:06 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info Apr 28 16:17:06 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleting offline snapshot 5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc of volume 1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] snapshot_file for this snap is: volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[244cb009-cdaf-4c05-b824-df2ff84ef2f0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:07 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.738s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleted volume successfully. Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-921c480d-2740-4478-a0df-9e646d79e388 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-09fb0486-2260-4961-a05a-870919d72f26-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:07 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:17:07 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:07 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info" returned: 0 in 0.776s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:07 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info is being set with open permissions: ugo+rw Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:07 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info Apr 28 16:17:07 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (a78a1763-8d11-47b5-b418-8c3720fad4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc646102-4df9-4b4a-a448-4a4e33dddbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc646102-4df9-4b4a-a448-4a4e33dddbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1494866075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae99427-72d2-47bc-a890-b8eb06f406c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:07Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98eec2c-2e11-4685-9292-5cb13d846fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98eec2c-2e11-4685-9292-5cb13d846fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82928e0-6605-4545-bcb8-0a088cfcaff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82928e0-6605-4545-bcb8-0a088cfcaff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae99427-72d2-47bc-a890-b8eb06f406c3', 'volume_name': 'volume-fae99427-72d2-47bc-a890-b8eb06f406c3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7f8ea6-5e41-4fea-be4f-78b380d8b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7f8ea6-5e41-4fea-be4f-78b380d8b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba5babf-2db3-44fa-90a6-998e23821f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Volume fae99427-72d2-47bc-a890-b8eb06f406c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae99427-72d2-47bc-a890-b8eb06f406c3', 'volume_size': 1} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:07 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.732s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f60e2-7c78-429b-9bed-0e2d4115a2b4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:07 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:17:07 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:08 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.info" returned: 0 in 0.673s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] snapshot: a8e1cc00-4d7b-469c-88f5-d61005b84bb3, volume: 63f28cda-5bbf-4aaa-a732-700029483654, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3608b87a-48f8-4c27-9264-e151e538e4ff]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:08 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:08 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:08 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 0.696s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:08 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:17:08 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:08 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.723s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3359629b-7830-4816-92da-384c9bb6dc78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9eb61e-ed8b-4ce5-ad3e-00ef004d7dc8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:08 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:08 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:09 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.679s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:09 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc Apr 28 16:17:09 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:09 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.690s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:09 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 Apr 28 16:17:09 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:09 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed.5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" returned: 0 in 0.603s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc" released by "_delete_snapshot" :: held 2.836s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" released by "delete_snapshot" :: held 2.868s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:09 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['18988c90-2134-4463-af08-b74ff5fe2a86', '50290f96-c696-450a-ae3d-9704675ebb22', '00d19af4-8682-4c05-808e-9a3b656c1972', 'b0d80814-f3c2-4288-b70b-4ea928c548e5'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:10 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Delete snapshot completed successfully. Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b609cb1b-2be4-47e2-80b7-31a2cb208248 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-5f2e8afe-5ae6-477b-9fb7-0b1b55e754fc-delete_snapshot" released by "delete_snapshot" :: held 3.011s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f347748-ee19-4277-ab1d-a7e567c66e1d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:10 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:17:10 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:12 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 1.814s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:12 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed Apr 28 16:17:12 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:13 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" returned: 0 in 1.239s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed" released by "delete_volume" :: held 3.126s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['b3b4cf2b-0cd6-4048-bead-88bc78fef753', '7e891271-3b94-4713-a23b-8c8829b26990', 'bdf66a32-5fbf-444a-831f-cabfa0950697', 'e718d903-c763-4801-903c-2fe49fcbac53'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:14 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:14 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (7d9513ec-3122-477c-9cae-76e154d666b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd03fad-f987-4538-989c-8cec79b54e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd03fad-f987-4538-989c-8cec79b54e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-958913806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9e1dcd-710c-40eb-a507-65ad5a828a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:15Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e432ce46-1430-439b-82b1-cdeb45040e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e432ce46-1430-439b-82b1-cdeb45040e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4082ae-9e64-4ad0-a745-706ab386b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4082ae-9e64-4ad0-a745-706ab386b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9e1dcd-710c-40eb-a507-65ad5a828a19', 'volume_name': 'volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90790629-4bb8-4337-a46d-8f56ac1a288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:15 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90790629-4bb8-4337-a46d-8f56ac1a288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1a4e03-d87e-4179-836b-dcc29d62cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume 3c9e1dcd-710c-40eb-a507-65ad5a828a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19', 'volume_size': 1} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654" returned: 0 in 5.612s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcbc4dd-b8dd-4486-b947-5f4c243c3ab7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:15 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.326s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleted volume successfully. Apr 28 16:17:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-33bb6901-1a46-414f-b065-861219e2abd3 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-1d553bdf-8fb1-4a1c-a5d6-237f8391d2ed-delete_volume" released by "delete_volume" :: held 5.022s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:15 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:15 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:16 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.847s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:17:16 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Converted 1024.00 MB image at 182.45 MB/s Apr 28 16:17:16 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 is being set with open permissions: ugo+rw Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:16 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 Apr 28 16:17:16 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:16 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654" returned: 0 in 0.609s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" released by "_copy_volume_from_snapshot" :: held 8.567s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-quobyte-a8e1cc00-4d7b-469c-88f5-d61005b84bb3" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-a8e1cc00-4d7b-469c-88f5-d61005b84bb3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Deleting offline snapshot a8e1cc00-4d7b-469c-88f5-d61005b84bb3 of volume 3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] snapshot_file for this snap is: volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[197f2207-3ea9-402e-aa00-60e396361d3a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:16 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:16 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:17 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.696s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3359629b-7830-4816-92da-384c9bb6dc78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:17 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[43728014-e620-41ac-bed2-f201c5656aab]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:17 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:17 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:18 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.732s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:18 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:18 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:18 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.660s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:18 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3 Apr 28 16:17:18 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:19 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78.a8e1cc00-4d7b-469c-88f5-d61005b84bb3" returned: 0 in 0.589s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-a8e1cc00-4d7b-469c-88f5-d61005b84bb3" released by "_delete_snapshot" :: held 2.756s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.039s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.238s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-146227697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cf71c0-941f-4ee7-9307-053bd67bf600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7cdf4ba9d334935bc55b5226ebe1138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:01Z,use_quota=True,user_id='23c948ce36d4423e921b90c39c809aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Creating volume 48cf71c0-941f-4ee7-9307-053bd67bf600 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:19 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488b16b-ae65-40be-9502-3ad654a93d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f28cda-5bbf-4aaa-a732-700029483654', 'volume_size': 2, 'source_volid': '3359629b-7830-4816-92da-384c9bb6dc78', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:19 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 1073741824 Apr 28 16:17:19 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a79e81-4fc6-4a1a-8489-e0020808ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:19 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Volume volume-63f28cda-5bbf-4aaa-a732-700029483654 (63f28cda-5bbf-4aaa-a732-700029483654): created successfully Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a79e81-4fc6-4a1a-8489-e0020808ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Flow 'volume_create_manager' (7cac62af-a161-40d6-a761-675866e66649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:19 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0c52044f-1b27-461a-9b60-6e96d8c12be3 tempest-VolumesCloneTest-197891108 None] Created volume successfully. Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-63f28cda-5bbf-4aaa-a732-700029483654-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "cinder-63f28cda-5bbf-4aaa-a732-700029483654-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb35b5d-0d02-4e35-b711-df34c968e395]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:20 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 Apr 28 16:17:20 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:20 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 1073741824" returned: 0 in 0.806s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:20 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 Apr 28 16:17:20 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:20 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654" returned: 0 in 0.729s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:20 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654 Apr 28 16:17:20 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:20 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600" returned: 0 in 0.607s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.298s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1494866075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae99427-72d2-47bc-a890-b8eb06f406c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:07Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Creating volume fae99427-72d2-47bc-a890-b8eb06f406c3 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:20 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:20 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 1073741824 Apr 28 16:17:20 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0665fb17-011c-48e2-86ca-49f2d3911350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cf71c0-941f-4ee7-9307-053bd67bf600', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a716d63d-22a7-41b0-84e9-7bee6764f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:20 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Volume volume-48cf71c0-941f-4ee7-9307-053bd67bf600 (48cf71c0-941f-4ee7-9307-053bd67bf600): created successfully Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a716d63d-22a7-41b0-84e9-7bee6764f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Flow 'volume_create_manager' (dfc5e42c-f15e-4492-bc57-baa6bd09efb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2a0dc5b9-476c-41dd-b360-e06dfebab71b tempest-VolumesTransfersTest-4762675 None] Created volume successfully. Apr 28 16:17:21 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-63f28cda-5bbf-4aaa-a732-700029483654" returned: 0 in 0.642s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-63f28cda-5bbf-4aaa-a732-700029483654" released by "delete_volume" :: held 1.409s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Created reservations ['82d471be-b80f-44b0-bd83-3356d4ff4101', '1668d3ee-3cfb-488b-ad29-826ad0aaa810', 'c047df0d-99bc-4491-bd77-6ad0e0c43832', 'c5b111bc-40ec-4721-82bf-12bd503f0d7d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:21 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:21 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "cinder-48cf71c0-941f-4ee7-9307-053bd67bf600-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-48cf71c0-941f-4ee7-9307-053bd67bf600-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "cinder-quobyte-48cf71c0-941f-4ee7-9307-053bd67bf600" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-quobyte-48cf71c0-941f-4ee7-9307-053bd67bf600" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:21 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 1073741824" returned: 0 in 0.856s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b31982-401f-4263-a0cd-cb5e52a3edb4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:21 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 Apr 28 16:17:21 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:21 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 Apr 28 16:17:21 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:22 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.685s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-3359629b-7830-4816-92da-384c9bb6dc78-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:22 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Deleted volume successfully. Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "cinder-3359629b-7830-4816-92da-384c9bb6dc78-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-48ef3e3c-edf3-4c79-9ce9-32add97312c4 tempest-VolumesCloneTest-197891108 None] Lock "cinder-63f28cda-5bbf-4aaa-a732-700029483654-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Acquiring lock "cinder-quobyte-3359629b-7830-4816-92da-384c9bb6dc78" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-3359629b-7830-4816-92da-384c9bb6dc78" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de4afa-1d84-4528-ba23-b08cf060bf5c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:22 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3" returned: 0 in 0.638s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.318s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-958913806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9e1dcd-710c-40eb-a507-65ad5a828a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:15Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating volume 3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:22 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:22 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:22 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba5babf-2db3-44fa-90a6-998e23821f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae99427-72d2-47bc-a890-b8eb06f406c3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e48fdd3-5010-401f-b96f-106229323b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:22 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 1073741824 Apr 28 16:17:22 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:22 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Volume volume-fae99427-72d2-47bc-a890-b8eb06f406c3 (fae99427-72d2-47bc-a890-b8eb06f406c3): created successfully Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e48fdd3-5010-401f-b96f-106229323b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (a78a1763-8d11-47b5-b418-8c3720fad4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:22 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600" returned: 0 in 0.760s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:22 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7d01534c-dfbb-4f40-ad2d-bad077801136 tempest-VolumesListAdminTestJSON-1226621910 None] Created volume successfully. Apr 28 16:17:22 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600 Apr 28 16:17:22 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:23 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.782s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:23 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78 Apr 28 16:17:23 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:23 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48cf71c0-941f-4ee7-9307-053bd67bf600" returned: 0 in 0.728s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-quobyte-48cf71c0-941f-4ee7-9307-053bd67bf600" released by "delete_volume" :: held 1.550s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:23 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 1073741824" returned: 0 in 0.880s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (d4f0a04d-077e-4522-96a7-b4d00a279031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7012477-faac-40d5-9df1-1099d2361230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Created reservations ['77782cf2-8dad-487f-9565-a2be4e00eb4d', 'f1018483-8424-451e-b63c-dfdaceec7883', '6bba8728-72bf-473e-a31c-50c4f0a53ca8', 'ba8063be-7733-4805-b455-a9b2f00bd846'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7012477-faac-40d5-9df1-1099d2361230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1294875537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e38b69-7abd-470c-9fe6-8954f4f9e374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:23Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:23 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:23 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11f120d-4d86-498e-b14d-b7eb96563943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11f120d-4d86-498e-b14d-b7eb96563943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70664c75-a1af-43b2-8ff0-87eafd22b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70664c75-a1af-43b2-8ff0-87eafd22b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e38b69-7abd-470c-9fe6-8954f4f9e374', 'volume_name': 'volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bf86d2-0a37-4ab8-8b4f-7a3d6199fb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0bf86d2-0a37-4ab8-8b4f-7a3d6199fb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f485dc94-1b3d-431e-9213-d7770d10d0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Volume a8e38b69-7abd-470c-9fe6-8954f4f9e374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374', 'volume_size': 1} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:23 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:23 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:23 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3359629b-7830-4816-92da-384c9bb6dc78" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "cinder-quobyte-3359629b-7830-4816-92da-384c9bb6dc78" released by "delete_volume" :: held 1.580s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Created reservations ['50f7acf6-6f0f-4140-9c62-e5d502fa02d2', '1d57a339-d202-436d-b9a1-cbe24ffe966f', 'b2f3cd47-02be-4778-8df9-32f30bf38945', 'c130d6b1-0811-4012-ab3c-f411b05391c9'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:24 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:24 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:24 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.658s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1294875537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e38b69-7abd-470c-9fe6-8954f4f9e374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:23Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Creating volume a8e38b69-7abd-470c-9fe6-8954f4f9e374 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:24 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1a4e03-d87e-4179-836b-dcc29d62cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:24 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 1073741824 Apr 28 16:17:24 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2824e-27c1-4ed5-b4ae-51800a898afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:24 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 (3c9e1dcd-710c-40eb-a507-65ad5a828a19): created successfully Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2824e-27c1-4ed5-b4ae-51800a898afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (7d9513ec-3122-477c-9cae-76e154d666b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-cf3e6e9a-655b-47a4-9ac7-7f2d83ae7781 tempest-VolumesSnapshotTestJSON-1255076549 None] Created volume successfully. Apr 28 16:17:24 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.720s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Deleted volume successfully. Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4728dfcb-1dcc-4d27-9976-08053b07c799 tempest-VolumesTransfersTest-217875770 None] Lock "cinder-48cf71c0-941f-4ee7-9307-053bd67bf600-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:24 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.857s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Deleted volume successfully. Apr 28 16:17:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8cc0cd2c-31a6-4076-8a59-e9d3d760e820 tempest-VolumesCloneTest-197891108 None] Lock "cinder-3359629b-7830-4816-92da-384c9bb6dc78-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:25 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 1073741824" returned: 0 in 1.048s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:25 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 Apr 28 16:17:25 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:26 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374" returned: 0 in 0.763s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Creating offline snapshot 3e27df2d-c4a8-408e-8241-49f93405cd9c of volume 3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f485dc94-1b3d-431e-9213-d7770d10d0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee8395a-dffc-4cbc-83c5-c6a70b1b2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[18120688-22b6-457e-ad36-19cbc465a018]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:26 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Volume volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 (a8e38b69-7abd-470c-9fe6-8954f4f9e374): created successfully Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee8395a-dffc-4cbc-83c5-c6a70b1b2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (d4f0a04d-077e-4522-96a7-b4d00a279031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:26 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9a0a94f8-625f-4bbc-ae02-11d89e956bf6 tempest-VolumesListAdminTestJSON-1226621910 None] Created volume successfully. Apr 28 16:17:26 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:26 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:26 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.855s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:26 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c 1G Apr 28 16:17:26 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (4278b9c6-0e36-44e8-b00b-596e8b50a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fbcca7-589b-4df5-8df7-29bdc901336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fbcca7-589b-4df5-8df7-29bdc901336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94501786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb58d0-a49f-49c5-bc3f-cffa56e44557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:27Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb4725d-689a-4a3d-b1a6-fe9363dc66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb4725d-689a-4a3d-b1a6-fe9363dc66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689065c9-16ec-4934-90f8-0dce44f64634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689065c9-16ec-4934-90f8-0dce44f64634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eb58d0-a49f-49c5-bc3f-cffa56e44557', 'volume_name': 'volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30c56bc-281e-43b4-b850-312ea3dcf5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30c56bc-281e-43b4-b850-312ea3dcf5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6add572f-8e64-471c-8c63-2448a3f0b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Volume 98eb58d0-a49f-49c5-bc3f-cffa56e44557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557', 'volume_size': 1} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:27 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c 1G" returned: 0 in 1.039s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:28 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:28 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Flow 'volume_create_manager' (7aad4328-e0d6-406f-9de9-1787b8eca03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0a892e-f235-48e8-b468-1e4937ce3185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0a892e-f235-48e8-b468-1e4937ce3185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2052528151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c487ac-0c61-4527-96db-0d0baf69d82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752654977ca467ebc5ff174af795cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:28Z,use_quota=True,user_id='185c123879fd45f79b81a3195cb71273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c252c802-8909-441e-98a7-97265f5ed241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c252c802-8909-441e-98a7-97265f5ed241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfeb6eba-ea44-4f12-aa63-f51ed9a5466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfeb6eba-ea44-4f12-aa63-f51ed9a5466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c487ac-0c61-4527-96db-0d0baf69d82f', 'volume_name': 'volume-76c487ac-0c61-4527-96db-0d0baf69d82f', 'volume_size': 2}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355e4b34-bdb3-4a05-ba83-953c9c1a1361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355e4b34-bdb3-4a05-ba83-953c9c1a1361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b5932e-de00-4471-8aa8-180bda9179e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:28 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Volume 76c487ac-0c61-4527-96db-0d0baf69d82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c487ac-0c61-4527-96db-0d0baf69d82f', 'volume_size': 2} Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:28 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.708s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:28 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c is being set with open permissions: ugo+rw Apr 28 16:17:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:28 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:28 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:29 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.633s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:29 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info Apr 28 16:17:29 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:29 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info" returned: 0 in 0.626s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:29 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info is being set with open permissions: ugo+rw Apr 28 16:17:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:30 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info Apr 28 16:17:30 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Flow 'volume_create_manager' (b344ec5f-59c4-4eb5-9152-308bcb83674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1bba9f-59fc-44ff-a85c-21479e4e83d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1bba9f-59fc-44ff-a85c-21479e4e83d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1608522843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fe2226-bea0-40ee-a751-f625a406cd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3f11675b1b4cfd9657e019f6a81063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:30Z,use_quota=True,user_id='bf448027220d41fd95e6becd2f7eb3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f1da40-197c-4133-b010-277e498050f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f1da40-197c-4133-b010-277e498050f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5ad327-150b-48b8-a6c6-5ded1634bac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5ad327-150b-48b8-a6c6-5ded1634bac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fe2226-bea0-40ee-a751-f625a406cd11', 'volume_name': 'volume-53fe2226-bea0-40ee-a751-f625a406cd11', 'volume_size': 2}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f77606d-1ffa-4dde-ad69-d1634e5dcd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f77606d-1ffa-4dde-ad69-d1634e5dcd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc5661b-3e1f-420e-ad07-5a214b17d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:30 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Volume 53fe2226-bea0-40ee-a751-f625a406cd11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fe2226-bea0-40ee-a751-f625a406cd11', 'volume_size': 2} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:30 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.info" returned: 0 in 0.596s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.274s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-94501786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb58d0-a49f-49c5-bc3f-cffa56e44557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4c471f3a5a4804a7c268aaaa2a41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:27Z,use_quota=True,user_id='33023c4b06ca484da3215b505bcd7e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Creating volume 98eb58d0-a49f-49c5-bc3f-cffa56e44557 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:30 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:30 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 1073741824 Apr 28 16:17:30 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0888a151-7bfa-4f70-ab66-3d881c0f509e tempest-VolumesSnapshotTestJSON-1255076549 None] Create snapshot completed successfully Apr 28 16:17:31 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 1073741824" returned: 0 in 0.801s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:31 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 Apr 28 16:17:31 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (4de5e75d-7232-4ce9-8e62-8445e3cb43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf7aa63-69c8-4533-b8b8-3e78cd216b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf7aa63-69c8-4533-b8b8-3e78cd216b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2006007678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d77515f-7b04-4377-87df-19e53869c65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67553332e09148b391b03a0bc1410b36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e27df2d-c4a8-408e-8241-49f93405cd9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:32Z,use_quota=True,user_id='c17c1be114a540f2852e91d65c18c6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184c4606-af0b-4c1f-b3c4-33f85d4cf76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184c4606-af0b-4c1f-b3c4-33f85d4cf76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db53079-9857-49d8-b886-b9584d1f96e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db53079-9857-49d8-b886-b9584d1f96e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d77515f-7b04-4377-87df-19e53869c65a', 'volume_name': 'volume-1d77515f-7b04-4377-87df-19e53869c65a', 'volume_size': 1, 'snapshot_id': '3e27df2d-c4a8-408e-8241-49f93405cd9c'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bf7d94-96fa-4fb4-a35c-7b77e5c924e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bf7d94-96fa-4fb4-a35c-7b77e5c924e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a06355-08c4-4634-b493-4290886f12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:31 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume 1d77515f-7b04-4377-87df-19e53869c65a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d77515f-7b04-4377-87df-19e53869c65a', 'volume_size': 1, 'snapshot_id': '3e27df2d-c4a8-408e-8241-49f93405cd9c'} Apr 28 16:17:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:32 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557" returned: 0 in 0.582s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.755s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2052528151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c487ac-0c61-4527-96db-0d0baf69d82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c752654977ca467ebc5ff174af795cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:28Z,use_quota=True,user_id='185c123879fd45f79b81a3195cb71273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Creating volume 76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:32 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f 2147483648 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:32 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f 2147483648 Apr 28 16:17:32 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6add572f-8e64-471c-8c63-2448a3f0b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c7805-a60b-464b-a5e2-d615a1bc9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:32 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Volume volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 (98eb58d0-a49f-49c5-bc3f-cffa56e44557): created successfully Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176c7805-a60b-464b-a5e2-d615a1bc9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Flow 'volume_create_manager' (4278b9c6-0e36-44e8-b00b-596e8b50a966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:32 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-aa6bbde9-4b72-4858-8602-5cefbfc4a142 tempest-VolumesListAdminTestJSON-1226621910 None] Created volume successfully. Apr 28 16:17:32 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f 2147483648" returned: 0 in 0.926s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:33 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f Apr 28 16:17:33 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Flow 'volume_create_manager' (b6c2f56e-5c88-4d19-8caa-c1d4295725cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06c5968-4bbd-44a8-968b-6c45c0c2e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06c5968-4bbd-44a8-968b-6c45c0c2e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffec43d-7b97-482d-8b9d-ddf52302966c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47fecb9d5954b7292c3fcca7a361184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:33Z,use_quota=True,user_id='3e17c1df8cbb4ed5bbe26063bd821f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaefe9d-451c-448b-8f5c-7c92ef034bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eaefe9d-451c-448b-8f5c-7c92ef034bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1315423-959d-4086-a3e4-32ab88c6dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1315423-959d-4086-a3e4-32ab88c6dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffec43d-7b97-482d-8b9d-ddf52302966c', 'volume_name': 'volume-3ffec43d-7b97-482d-8b9d-ddf52302966c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb4a28d-eeb8-4f3d-aa4a-50081654f62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb4a28d-eeb8-4f3d-aa4a-50081654f62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5a0ad9-bc4c-45e0-a233-83dc531a4271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Volume 3ffec43d-7b97-482d-8b9d-ddf52302966c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffec43d-7b97-482d-8b9d-ddf52302966c', 'volume_size': 1} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:33 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f" returned: 0 in 0.599s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1608522843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fe2226-bea0-40ee-a751-f625a406cd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a3f11675b1b4cfd9657e019f6a81063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:30Z,use_quota=True,user_id='bf448027220d41fd95e6becd2f7eb3b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Creating volume 53fe2226-bea0-40ee-a751-f625a406cd11 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:33 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 2147483648 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:33 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 2147483648 Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b5932e-de00-4471-8aa8-180bda9179e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c487ac-0c61-4527-96db-0d0baf69d82f', 'volume_size': 2}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da91eb3d-b510-4b71-bf3b-1129dfb5cea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:33 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Volume volume-76c487ac-0c61-4527-96db-0d0baf69d82f (76c487ac-0c61-4527-96db-0d0baf69d82f): created successfully Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da91eb3d-b510-4b71-bf3b-1129dfb5cea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Flow 'volume_create_manager' (7aad4328-e0d6-406f-9de9-1787b8eca03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5d35c312-e8c9-46e4-9fb7-9b8ed5fed364 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Created volume successfully. Apr 28 16:17:34 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 2147483648" returned: 0 in 0.789s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:34 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 Apr 28 16:17:34 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:34 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11" returned: 0 in 0.574s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.263s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c-1d77515f-7b04-4377-87df-19e53869c65a" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c-1d77515f-7b04-4377-87df-19e53869c65a" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating volume 1d77515f-7b04-4377-87df-19e53869c65a from snapshot 3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc5661b-3e1f-420e-ad07-5a214b17d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fe2226-bea0-40ee-a751-f625a406cd11', 'volume_size': 2}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e2263-24e9-4a17-87c1-141c09d0f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] snapshot: 3e27df2d-c4a8-408e-8241-49f93405cd9c, volume: 1d77515f-7b04-4377-87df-19e53869c65a, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:17:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Volume volume-53fe2226-bea0-40ee-a751-f625a406cd11 (53fe2226-bea0-40ee-a751-f625a406cd11): created successfully Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a5e2263-24e9-4a17-87c1-141c09d0f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Flow 'volume_create_manager' (b344ec5f-59c4-4eb5-9152-308bcb83674c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a2e6aa76-bd83-435f-9540-98dbbc8ebc94 tempest-VolumesCloneNegativeTest-139905410 None] Created volume successfully. Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfd9dfc-7e29-4742-a58d-2f85ad5747d7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:35 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:35 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:35 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.724s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[614b1e5f-5a25-4b8b-b82b-45de9a6db52d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Acquiring lock "cinder-53fe2226-bea0-40ee-a751-f625a406cd11-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "cinder-53fe2226-bea0-40ee-a751-f625a406cd11-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Acquiring lock "cinder-quobyte-53fe2226-bea0-40ee-a751-f625a406cd11" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "cinder-quobyte-53fe2226-bea0-40ee-a751-f625a406cd11" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:35 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:35 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd3064-a7b0-491e-b8f9-896c8e5730ba]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:36 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 Apr 28 16:17:36 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:36 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.703s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:36 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:17:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:36 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a Apr 28 16:17:36 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:36 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11" returned: 0 in 0.714s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:36 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11 Apr 28 16:17:36 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:37 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-53fe2226-bea0-40ee-a751-f625a406cd11" returned: 0 in 0.589s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "cinder-quobyte-53fe2226-bea0-40ee-a751-f625a406cd11" released by "delete_volume" :: held 1.365s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Created reservations ['3a69a9c6-5ba8-4aa2-9fe1-6b911bc19fd3', 'e4a66d81-0246-4139-8580-669835b96b83', '75aaec51-f0a5-48de-804a-d9165b76c42f', '7500bc94-f625-414d-ae0b-d0ef7085780e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:37 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:37 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:39 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.408s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:39 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Deleted volume successfully. Apr 28 16:17:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d426d443-16bb-4140-adf7-7a040cc7fc74 tempest-VolumesCloneNegativeTest-139905410 None] Lock "cinder-53fe2226-bea0-40ee-a751-f625a406cd11-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:41 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a" returned: 0 in 5.301s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[315490d4-8853-4ecd-a83a-6bb35d6eaba6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:41 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:41 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:42 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.853s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:17:42 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Converted 1024.00 MB image at 193.14 MB/s Apr 28 16:17:42 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a is being set with open permissions: ugo+rw Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:42 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a Apr 28 16:17:42 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (dd3414a5-c631-43e8-8050-a85df51a4d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232a478c-bd45-4995-b7e7-ae6a9b7023bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232a478c-bd45-4995-b7e7-ae6a9b7023bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-991752491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5400c031-58c3-4aa5-8e75-940934ba9185,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:43Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d801bb-54c7-4743-aed0-86659df1ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d801bb-54c7-4743-aed0-86659df1ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b70938-3172-47c4-a656-4a559cf25afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b70938-3172-47c4-a656-4a559cf25afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5400c031-58c3-4aa5-8e75-940934ba9185', 'volume_name': 'volume-5400c031-58c3-4aa5-8e75-940934ba9185', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab333bd0-b06f-4122-86a3-6ae38e0acbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab333bd0-b06f-4122-86a3-6ae38e0acbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff19875-b9db-4a55-871b-fe8afc127996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:42 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Volume 5400c031-58c3-4aa5-8e75-940934ba9185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5400c031-58c3-4aa5-8e75-940934ba9185', 'volume_size': 1} Apr 28 16:17:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:43 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a" returned: 0 in 0.592s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" released by "_copy_volume_from_snapshot" :: held 8.280s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c-1d77515f-7b04-4377-87df-19e53869c65a" released by "_create_volume_from_snapshot" :: held 8.321s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.340s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.134s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffec43d-7b97-482d-8b9d-ddf52302966c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a47fecb9d5954b7292c3fcca7a361184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:33Z,use_quota=True,user_id='3e17c1df8cbb4ed5bbe26063bd821f45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Creating volume 3ffec43d-7b97-482d-8b9d-ddf52302966c {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:43 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:43 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c 1073741824 Apr 28 16:17:43 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a06355-08c4-4634-b493-4290886f12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d77515f-7b04-4377-87df-19e53869c65a', 'volume_size': 1, 'snapshot_id': '3e27df2d-c4a8-408e-8241-49f93405cd9c'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5085f60a-7a7b-412c-93be-7cd927a144a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:43 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Volume volume-1d77515f-7b04-4377-87df-19e53869c65a (1d77515f-7b04-4377-87df-19e53869c65a): created successfully Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5085f60a-7a7b-412c-93be-7cd927a144a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Flow 'volume_create_manager' (4de5e75d-7232-4ce9-8e62-8445e3cb43c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0ea1ecdf-59cd-42d4-8d55-732630483c76 tempest-VolumesSnapshotTestJSON-1255076549 None] Created volume successfully. Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-1d77515f-7b04-4377-87df-19e53869c65a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-1d77515f-7b04-4377-87df-19e53869c65a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e686b1cc-d309-4537-8d0a-45dd40724072]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:43 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a Apr 28 16:17:43 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:44 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c 1073741824" returned: 0 in 0.751s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:44 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c Apr 28 16:17:44 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:44 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a" returned: 0 in 0.702s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:44 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a Apr 28 16:17:44 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:44 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c" returned: 0 in 0.607s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.031s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Creating offline snapshot 6659241b-d173-4aef-a7e7-1303ac9caff6 of volume 76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5a0ad9-bc4c-45e0-a233-83dc531a4271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffec43d-7b97-482d-8b9d-ddf52302966c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1abda0-50a3-42af-8a2f-fa6c50989abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5547e8d4-1e88-48a9-a03b-e91efdc07777]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:44 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Volume volume-3ffec43d-7b97-482d-8b9d-ddf52302966c (3ffec43d-7b97-482d-8b9d-ddf52302966c): created successfully Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1abda0-50a3-42af-8a2f-fa6c50989abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Flow 'volume_create_manager' (b6c2f56e-5c88-4d19-8caa-c1d4295725cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8cb3eda5-6980-4501-bfc9-77cfa3c5987e tempest-VolumesListAdminTestJSON-1325784125 None] Created volume successfully. Apr 28 16:17:44 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f Apr 28 16:17:44 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:45 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d77515f-7b04-4377-87df-19e53869c65a" returned: 0 in 0.600s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-1d77515f-7b04-4377-87df-19e53869c65a" released by "delete_volume" :: held 1.348s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=115,cinder:SELECT=95,cinder:INSERT=32,cinder:DELETE=10 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['3e013363-7024-4fe0-b13a-89f27c7a4d41', '36cdb545-1b1e-419e-a139-05431571af0d', '7f815d26-744f-4c65-88d8-d6278b16b507', 'd674df2c-746b-4faa-8249-9654b0e3a9e7'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:45 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:45 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Acquiring lock "cinder-3ffec43d-7b97-482d-8b9d-ddf52302966c-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "cinder-3ffec43d-7b97-482d-8b9d-ddf52302966c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Acquiring lock "cinder-quobyte-3ffec43d-7b97-482d-8b9d-ddf52302966c" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "cinder-quobyte-3ffec43d-7b97-482d-8b9d-ddf52302966c" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c502d-9b84-4137-b250-898c6ec23316]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-98eb58d0-a49f-49c5-bc3f-cffa56e44557-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-98eb58d0-a49f-49c5-bc3f-cffa56e44557-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-quobyte-98eb58d0-a49f-49c5-bc3f-cffa56e44557" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-98eb58d0-a49f-49c5-bc3f-cffa56e44557" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:45 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:45 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c Apr 28 16:17:45 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f" returned: 0 in 0.810s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 2G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba30e353-eddd-4d8d-b524-93e774e4b182]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:45 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 2G Apr 28 16:17:45 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:45 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 Apr 28 16:17:45 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:46 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.771s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleted volume successfully. Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-3e27df2d-c4a8-408e-8241-49f93405cd9c-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-616730ee-a2ff-4663-b858-4f040550be53 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-1d77515f-7b04-4377-87df-19e53869c65a-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-3e27df2d-c4a8-408e-8241-49f93405cd9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleting offline snapshot 3e27df2d-c4a8-408e-8241-49f93405cd9c of volume 3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] snapshot_file for this snap is: volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d121b8f9-9b99-433f-82c9-2db1f0cfa635]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:46 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:46 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:46 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c" returned: 0 in 0.912s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:46 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c Apr 28 16:17:46 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:46 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557" returned: 0 in 0.816s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:46 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557 Apr 28 16:17:46 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:46 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 2G" returned: 0 in 0.989s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c487ac-0c61-4527-96db-0d0baf69d82f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:46 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c487ac-0c61-4527-96db-0d0baf69d82f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 Apr 28 16:17:46 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.801s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1aadf3-e335-4a71-92f4-d3e623af4f8f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:47 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3ffec43d-7b97-482d-8b9d-ddf52302966c" returned: 0 in 0.709s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-98eb58d0-a49f-49c5-bc3f-cffa56e44557" returned: 0 in 0.641s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "cinder-quobyte-3ffec43d-7b97-482d-8b9d-ddf52302966c" released by "delete_volume" :: held 1.681s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-98eb58d0-a49f-49c5-bc3f-cffa56e44557" released by "delete_volume" :: held 1.526s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Created reservations ['f5cf27a4-67e7-4316-8e27-3ccf297c9ecd', '372f4a1d-753e-45ff-bc2b-4ecb8007f5c9', '0c2cdc75-b726-425e-8c18-43c7302ad023', '923ff391-a9db-40e5-8bfe-382366e7c5fd'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Created reservations ['a595150e-27b2-4ba5-bd72-912f35338d56', 'dfb785f7-7f18-4a0e-8e7d-27ba35be2bff', '756354f8-e495-4405-b5fb-9527ec87907d', '73e23089-3aec-4680-9d69-6ddffa7b5420'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:47 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:47 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:47 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:47 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:47 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:47 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c487ac-0c61-4527-96db-0d0baf69d82f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6" returned: 0 in 0.791s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 is being set with open permissions: ugo+rw Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:47 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 Apr 28 16:17:47 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.836s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:47 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:47 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-a8e38b69-7abd-470c-9fe6-8954f4f9e374-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:47 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.700s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-a8e38b69-7abd-470c-9fe6-8954f4f9e374-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Deleted volume successfully. Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=93,cinder:UPDATE=140,cinder:DELETE=16,cinder:INSERT=24 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-73dcb57b-5fb4-4378-85e0-6b80b4d6d98e tempest-VolumesListAdminTestJSON-1325784125 None] Lock "cinder-3ffec43d-7b97-482d-8b9d-ddf52302966c-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:48 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-quobyte-a8e38b69-7abd-470c-9fe6-8954f4f9e374" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.805s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:48 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Deleted volume successfully. Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6" returned: 0 in 0.764s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-a8e38b69-7abd-470c-9fe6-8954f4f9e374" acquired by "delete_volume" :: waited 0.040s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-34b9977b-e5ba-4887-8cb9-7c8f169daf68 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-98eb58d0-a49f-49c5-bc3f-cffa56e44557-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2064741-6513-442c-81d0-abd7ee62f7da]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:48 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info Apr 28 16:17:48 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:48 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 Apr 28 16:17:48 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:48 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.834s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:48 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c Apr 28 16:17:48 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:48 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info" returned: 0 in 0.618s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:48 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info is being set with open permissions: ugo+rw Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:48 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info Apr 28 16:17:48 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:48 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374" returned: 0 in 0.745s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:48 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374 Apr 28 16:17:48 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:49 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19.3e27df2d-c4a8-408e-8241-49f93405cd9c" returned: 0 in 0.658s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3e27df2d-c4a8-408e-8241-49f93405cd9c" released by "_delete_snapshot" :: held 3.244s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" released by "delete_snapshot" :: held 3.272s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:49 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.info" returned: 0 in 0.599s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.540s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-991752491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5400c031-58c3-4aa5-8e75-940934ba9185,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:43Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Creating volume 5400c031-58c3-4aa5-8e75-940934ba9185 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:49 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:49 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 1073741824 Apr 28 16:17:49 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['2233697b-b8ff-4407-8ebe-e5b4a1da3c04', '65b7e4f4-ab18-40a8-9938-0b4f3ed24974', '00168a6f-cb8a-4278-b683-c1380bc12fd2', 'c84ee622-1a74-413c-8985-f6715196900b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-abf3ea27-b0af-4da0-a4ad-f20def0dc6eb tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Create snapshot completed successfully Apr 28 16:17:49 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a8e38b69-7abd-470c-9fe6-8954f4f9e374" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-a8e38b69-7abd-470c-9fe6-8954f4f9e374" released by "delete_volume" :: held 1.418s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Delete snapshot completed successfully. Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3d35b22f-98d7-493a-94cb-abeae1086769 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-3e27df2d-c4a8-408e-8241-49f93405cd9c-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Created reservations ['3201a74d-d35e-447d-b1ae-98b9d4dd7e7b', '066c4c2a-5e0d-442b-bbad-13ae0e485589', 'f881688f-f2d4-4c2b-b478-941af6211930', '2b045e50-1974-4e45-9ea4-8db54f8367fc'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:49 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:49 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:50 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 1073741824" returned: 0 in 0.758s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:50 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-fae99427-72d2-47bc-a890-b8eb06f406c3-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.631s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:50 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 Apr 28 16:17:50 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:50 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Deleted volume successfully. Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-fae99427-72d2-47bc-a890-b8eb06f406c3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ed1dbdc3-2357-4e72-8b92-5655f50f2912 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-a8e38b69-7abd-470c-9fe6-8954f4f9e374-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "cinder-quobyte-fae99427-72d2-47bc-a890-b8eb06f406c3" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-fae99427-72d2-47bc-a890-b8eb06f406c3" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-3c9e1dcd-710c-40eb-a507-65ad5a828a19-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b87b2-c531-44a6-a331-989b26b3e5ca]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "cinder-6659241b-d173-4aef-a7e7-1303ac9caff6-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-3c9e1dcd-710c-40eb-a507-65ad5a828a19-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-6659241b-d173-4aef-a7e7-1303ac9caff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "cinder-quobyte-6659241b-d173-4aef-a7e7-1303ac9caff6" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-6659241b-d173-4aef-a7e7-1303ac9caff6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Deleting offline snapshot 6659241b-d173-4aef-a7e7-1303ac9caff6 of volume 76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] snapshot_file for this snap is: volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" acquired by "delete_volume" :: waited 0.044s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:50 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 Apr 28 16:17:50 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d98b1-ef00-49bb-a10b-db0ec847854e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd95c09-587f-4043-b44b-eae83ad4006d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:50 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 Apr 28 16:17:50 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:50 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:50 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:51 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185" returned: 0 in 0.739s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff19875-b9db-4a55-871b-fe8afc127996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5400c031-58c3-4aa5-8e75-940934ba9185', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed65289b-1521-4014-bdab-9df10e265fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:51 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Volume volume-5400c031-58c3-4aa5-8e75-940934ba9185 (5400c031-58c3-4aa5-8e75-940934ba9185): created successfully Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed65289b-1521-4014-bdab-9df10e265fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (dd3414a5-c631-43e8-8050-a85df51a4d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8c83b1fd-b8c0-49a8-9843-ff9e0a1a4b6f tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:17:51 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3" returned: 0 in 0.846s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:51 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3 Apr 28 16:17:51 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:51 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:51 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6" returned: 0 in 0.807s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c487ac-0c61-4527-96db-0d0baf69d82f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.812s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c77c04a-f630-4c47-ba4c-e9490241f3e2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:51 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19 Apr 28 16:17:51 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:51 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f Apr 28 16:17:51 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:52 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fae99427-72d2-47bc-a890-b8eb06f406c3" returned: 0 in 0.757s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-quobyte-fae99427-72d2-47bc-a890-b8eb06f406c3" released by "delete_volume" :: held 1.690s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Created reservations ['29123bf4-3ebe-47fe-8f47-bbbdce2f91f4', 'ccc5e138-8d10-42bc-86ab-59285dd4f9cc', '618a7408-a95c-4b37-b187-48baaafa9504', '19d83679-1548-4567-9a33-0edfcf7f944a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:17:52 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (1f610992-55b3-4b0e-b2e8-3df2287aead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a6b93a-ada6-4874-a28e-1717b96df624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-3c9e1dcd-710c-40eb-a507-65ad5a828a19" returned: 0 in 0.800s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a6b93a-ada6-4874-a28e-1717b96df624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1434618398',display_name='tempest-VolumesGetTest-Volume-2084336869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76e601-d378-4816-b053-6e28c9299f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:52Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f86b04-e3b6-4026-a5ba-3c360db71024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f86b04-e3b6-4026-a5ba-3c360db71024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82588994-ea1e-40af-bf6a-2946091a2e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82588994-ea1e-40af-bf6a-2946091a2e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e76e601-d378-4816-b053-6e28c9299f7f', 'volume_name': 'volume-1e76e601-d378-4816-b053-6e28c9299f7f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eaf25df-47b6-4acd-b920-a42583049f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eaf25df-47b6-4acd-b920-a42583049f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e754428b-1566-40cd-9e08-8d524eb0c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:52 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Volume 1e76e601-d378-4816-b053-6e28c9299f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e76e601-d378-4816-b053-6e28c9299f7f', 'volume_size': 1} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1434618398',display_name='tempest-VolumesGetTest-Volume-2084336869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e76e601-d378-4816-b053-6e28c9299f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:17:52Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Creating volume 1e76e601-d378-4816-b053-6e28c9299f7f {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:17:52 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-3c9e1dcd-710c-40eb-a507-65ad5a828a19" released by "delete_volume" :: held 1.757s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:52 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f 1073741824 Apr 28 16:17:52 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:52 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f" returned: 0 in 0.937s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:52 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:52 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:52 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 Apr 28 16:17:52 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['37d02389-6744-4092-9456-51e835a5a390', '70719d79-2c51-4b8c-9fe2-3c59ee28169f', '6844b36d-c295-4f54-a622-8fff99f6ffeb', '2ae59157-ca0b-41c4-b8ae-076d6ba69e38'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:52 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:52 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad68484-1acd-400a-b72c-ebcdaa12daff]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:53 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 Apr 28 16:17:53 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:53 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.074s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Deleted volume successfully. Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e388030-8694-427d-8466-51ffe3251218 tempest-VolumesListAdminTestJSON-1226621910 None] Lock "cinder-fae99427-72d2-47bc-a890-b8eb06f406c3-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:53 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.924s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Deleted volume successfully. Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b75bf04f-3534-4ab7-9d6f-c48385041cf1 tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-3c9e1dcd-710c-40eb-a507-65ad5a828a19-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:53 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f 1073741824" returned: 0 in 1.240s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:53 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6" returned: 0 in 1.189s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:53 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6 Apr 28 16:17:53 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:53 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f Apr 28 16:17:53 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:54 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" returned: 0 in 1.072s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:54 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4 Apr 28 16:17:54 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:54 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f" returned: 0 in 0.666s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e754428b-1566-40cd-9e08-8d524eb0c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e76e601-d378-4816-b053-6e28c9299f7f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ee9ffe-124a-4af6-a33f-a16ef8845452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:17:54 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Volume volume-1e76e601-d378-4816-b053-6e28c9299f7f (1e76e601-d378-4816-b053-6e28c9299f7f): created successfully Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ee9ffe-124a-4af6-a33f-a16ef8845452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (1f610992-55b3-4b0e-b2e8-3df2287aead9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:17:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a251511c-6a9c-41f5-9f38-511ec37647b9 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:17:54 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f.6659241b-d173-4aef-a7e7-1303ac9caff6" returned: 0 in 0.798s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-6659241b-d173-4aef-a7e7-1303ac9caff6" released by "_delete_snapshot" :: held 3.885s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" released by "delete_snapshot" :: held 3.924s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Created reservations ['0d10bf35-40d6-4423-a2d8-d358e756de2d', 'a424b772-f016-4cc6-8f67-750274b1425a', '2fd457b1-73d1-4a30-bebc-4a644e069e49', '30c6faf9-4a83-4f14-a559-7b7b417e10ba'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Delete snapshot completed successfully. Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-06c62b9b-1e49-43c0-b482-877839b496cc tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-6659241b-d173-4aef-a7e7-1303ac9caff6-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "cinder-76c487ac-0c61-4527-96db-0d0baf69d82f-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-76c487ac-0c61-4527-96db-0d0baf69d82f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:55 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" returned: 0 in 0.739s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-quobyte-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4" released by "delete_volume" :: held 1.927s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0723be-f7b6-425c-9a69-f25fcbe0902e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Created reservations ['f647c0c0-08f4-427d-af74-b1e7ea94a396', '83eae274-d7fb-4d5b-91b5-32e10897beab', '8ee27338-58e7-4ea6-bda2-adf7b221f24b', '247166e7-7c28-48c7-a5b0-5d8fcb07b5d9'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:55 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f Apr 28 16:17:55 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:55 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:55 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-1e76e601-d378-4816-b053-6e28c9299f7f-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "cinder-1e76e601-d378-4816-b053-6e28c9299f7f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-1e76e601-d378-4816-b053-6e28c9299f7f" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-1e76e601-d378-4816-b053-6e28c9299f7f" acquired by "delete_volume" :: waited 0.046s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:56 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f" returned: 0 in 1.067s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfcfb6c-643d-4af9-9439-bd9de61ed1ae]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:56 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f Apr 28 16:17:56 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:56 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.002s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:56 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Deleted volume successfully. Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-857f9d79-5875-401d-8e41-b02d6aa0046c tempest-VolumesSnapshotTestJSON-1255076549 None] Lock "cinder-146f8a6f-70d9-484b-9e9d-0d55ebe5f6a4-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:56 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f Apr 28 16:17:56 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:56 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76c487ac-0c61-4527-96db-0d0baf69d82f" returned: 0 in 0.771s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-quobyte-76c487ac-0c61-4527-96db-0d0baf69d82f" released by "delete_volume" :: held 1.909s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Created reservations ['aaac9fef-2b52-47c2-be54-6ec66a5ee046', 'd44a01cd-6068-4004-ab6e-07fef368d661', 'ab3707e5-f053-4fe4-bcb3-9c86bbe71c66', '5d515439-b65c-4e67-be46-279e520ef782'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:57 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f" returned: 0 in 0.929s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:57 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f Apr 28 16:17:57 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:57 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:57 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:57 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1e76e601-d378-4816-b053-6e28c9299f7f" returned: 0 in 0.823s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-1e76e601-d378-4816-b053-6e28c9299f7f" released by "delete_volume" :: held 1.843s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Created reservations ['692b6dc1-355e-4e11-bdfb-77febe7f2b77', '8aa4cdf4-ff79-4ffd-8498-34a0ef8a9ba9', '08513625-1672-4402-88a3-3b2776e48310', '5460a348-c35f-4378-a46f-d541a41fab9b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:58 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.984s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:58 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Deleted volume successfully. Apr 28 16:17:58 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:17:58 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f93f687-1c86-460c-800b-27c357322434 tempest-VolumesSnapshotNegativeTestJSON-827868989 None] Lock "cinder-76c487ac-0c61-4527-96db-0d0baf69d82f-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-5400c031-58c3-4aa5-8e75-940934ba9185-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "cinder-5400c031-58c3-4aa5-8e75-940934ba9185-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-5400c031-58c3-4aa5-8e75-940934ba9185" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-5400c031-58c3-4aa5-8e75-940934ba9185" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fabd55-3069-4808-9141-6e5a5893b831]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:17:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:58 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 Apr 28 16:17:58 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:17:59 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.829s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:59 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:17:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:17:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-87195683-0d7a-45ee-875f-063202f1ffe9 tempest-VolumesGetTest-252979578 None] Lock "cinder-1e76e601-d378-4816-b053-6e28c9299f7f-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:17:59 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Apr 28 16:17:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185" returned: 0 in 0.864s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:17:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:17:59 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185 Apr 28 16:17:59 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:00 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-5400c031-58c3-4aa5-8e75-940934ba9185" returned: 0 in 0.769s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-5400c031-58c3-4aa5-8e75-940934ba9185" released by "delete_volume" :: held 1.675s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Created reservations ['7b494a13-e00f-47d8-9f7d-98f7a4789bbe', '7d934452-5374-4d3a-9526-e5b3268cc807', 'f3137e14-e5e2-4160-a1f2-32441f20a0ff', '7b000bf7-2a40-462a-ba0d-87316bc17a69'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:00 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:00 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:00 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:00 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:01 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.978s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0578971c-8c3a-4ec7-9ba2-6f129cdb15e1 tempest-VolumesGetTest-252979578 None] Lock "cinder-5400c031-58c3-4aa5-8e75-940934ba9185-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (81027329-a623-4d99-8997-64b6b3376d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3c3366-3d03-4992-b74a-215b19d3ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3c3366-3d03-4992-b74a-215b19d3ce30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122248494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f693c3-6bc3-458a-b8b5-cbc72b087ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:01Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a993dc19-797f-4ba3-ac06-581751363bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a993dc19-797f-4ba3-ac06-581751363bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38448311-8831-460c-92e2-55ced5d2c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38448311-8831-460c-92e2-55ced5d2c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'volume_name': 'volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e60850-1cf9-4ff7-b9c5-7818ea09e7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e60850-1cf9-4ff7-b9c5-7818ea09e7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db1d957-c0b5-4d8d-83d8-87ca66ff6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:01 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Volume 38f693c3-6bc3-458a-b8b5-cbc72b087ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'volume_size': 1} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1122248494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f693c3-6bc3-458a-b8b5-cbc72b087ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:01Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Creating volume 38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:01 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:01 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 1073741824 Apr 28 16:18:01 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:01 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.132s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:02 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 1073741824" returned: 0 in 0.996s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:02 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:02 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:03 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 1.073s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db1d957-c0b5-4d8d-83d8-87ca66ff6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7c96b6-a669-4ad2-b7c9-5258374766d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:03 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Volume volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 (38f693c3-6bc3-458a-b8b5-cbc72b087ec1): created successfully Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7c96b6-a669-4ad2-b7c9-5258374766d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (81027329-a623-4d99-8997-64b6b3376d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9177ede3-130c-4336-b93a-0faa01438273 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (cdd3390e-1dd0-4c27-93cf-34d74557af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9090158f-874d-4306-82a3-6907f7aeca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9090158f-874d-4306-82a3-6907f7aeca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206734100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e193be-afff-483e-9d61-0b43c44010c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:04Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31426420-ad34-41ae-b07c-5bf3ebabee49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31426420-ad34-41ae-b07c-5bf3ebabee49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ebb5c-4888-46c5-b41a-74c68c91c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ebb5c-4888-46c5-b41a-74c68c91c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e193be-afff-483e-9d61-0b43c44010c5', 'volume_name': 'volume-d2e193be-afff-483e-9d61-0b43c44010c5', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f39f77-8f14-4f02-93c8-e4e69bbf47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f39f77-8f14-4f02-93c8-e4e69bbf47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924bdd6e-4ef3-4273-8dff-fa11dd087f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:04 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume d2e193be-afff-483e-9d61-0b43c44010c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e193be-afff-483e-9d61-0b43c44010c5', 'volume_size': 1} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206734100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e193be-afff-483e-9d61-0b43c44010c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:04Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume d2e193be-afff-483e-9d61-0b43c44010c5 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:04 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:04 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 1073741824 Apr 28 16:18:04 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (ab6f0778-cfbb-4b68-b7b6-9c8abdcf13d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a423c048-8737-47aa-a7a0-96c989f1c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a423c048-8737-47aa-a7a0-96c989f1c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-769868251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16001268-2218-456b-af17-7b06b3a6e0ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=38f693c3-6bc3-458a-b8b5-cbc72b087ec1,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:05Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567cb020-3463-4c1d-ac74-685c9bd0418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567cb020-3463-4c1d-ac74-685c9bd0418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbade7b7-3a8e-4c1c-bdf4-a6ff692a327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbade7b7-3a8e-4c1c-bdf4-a6ff692a327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '16001268-2218-456b-af17-7b06b3a6e0ce', 'volume_name': 'volume-16001268-2218-456b-af17-7b06b3a6e0ce', 'volume_size': 1, 'source_volid': '38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeedd73-8079-407e-9fb2-a16aed025b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feeedd73-8079-407e-9fb2-a16aed025b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541d8ddd-0c2e-4526-8fd7-7a1e5a04dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:05 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Volume 16001268-2218-456b-af17-7b06b3a6e0ce: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-16001268-2218-456b-af17-7b06b3a6e0ce', 'volume_size': 1, 'source_volid': '38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'source_volstatus': 'available'} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:05 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 1073741824" returned: 0 in 1.082s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:05 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 Apr 28 16:18:05 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:06 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5" returned: 0 in 0.640s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.738s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:06 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Cloning volume 38f693c3-6bc3-458a-b8b5-cbc72b087ec1 to volume 16001268-2218-456b-af17-7b06b3a6e0ce Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924bdd6e-4ef3-4273-8dff-fa11dd087f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e193be-afff-483e-9d61-0b43c44010c5', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dcccf2-6b6b-4567-9590-d873f9d51a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:06 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-d2e193be-afff-483e-9d61-0b43c44010c5 (d2e193be-afff-483e-9d61-0b43c44010c5): created successfully Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dcccf2-6b6b-4567-9590-d873f9d51a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (cdd3390e-1dd0-4c27-93cf-34d74557af79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Creating offline snapshot f10abce7-c6d9-4447-895e-945ee7759625 of volume 38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:18:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8a3f46f3-9cdd-452b-a0a2-5e9f32de8bf0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec58463-cea7-4bad-8e8a-85baa778fac4]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:06 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:06 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (895832cb-6156-48e8-9ca7-b0f2a5457a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cfead0-b76e-419b-a3a8-48f5e1574650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cfead0-b76e-419b-a3a8-48f5e1574650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227526444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516c81e6-4545-404b-ba0d-6f03c1e929fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:07Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df48eec-065a-4aae-a7ec-e6f4e8a5235e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df48eec-065a-4aae-a7ec-e6f4e8a5235e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bc639-59e9-4607-a025-94a1369a0a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bc639-59e9-4607-a025-94a1369a0a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516c81e6-4545-404b-ba0d-6f03c1e929fc', 'volume_name': 'volume-516c81e6-4545-404b-ba0d-6f03c1e929fc', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7aabacd-cf92-44d2-906c-8cdd6e756ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7aabacd-cf92-44d2-906c-8cdd6e756ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ca4482-c761-41d5-8655-a4bad96d583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume 516c81e6-4545-404b-ba0d-6f03c1e929fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516c81e6-4545-404b-ba0d-6f03c1e929fc', 'volume_size': 1} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:07 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 0.981s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:07 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 1G Apr 28 16:18:07 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (8efcbb0a-6a24-4e82-82f8-ef524e792695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844d24b5-860e-4f5d-b155-160bbdeedbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844d24b5-860e-4f5d-b155-160bbdeedbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42079797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5059be-776c-4980-bac0-1858ef17f6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:08Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4228f5b5-b430-4c24-a2a1-1176e40e407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4228f5b5-b430-4c24-a2a1-1176e40e407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457d505b-e0a5-44a2-a801-3304bdd1d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457d505b-e0a5-44a2-a801-3304bdd1d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5059be-776c-4980-bac0-1858ef17f6f6', 'volume_name': 'volume-4b5059be-776c-4980-bac0-1858ef17f6f6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3d8222-1b97-4d0e-b6cc-ad9f865995b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3d8222-1b97-4d0e-b6cc-ad9f865995b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399986fe-801e-47c9-8e9f-5b1e12a49d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume 4b5059be-776c-4980-bac0-1858ef17f6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5059be-776c-4980-bac0-1858ef17f6f6', 'volume_size': 1} Apr 28 16:18:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (a15382f7-0496-43ca-a074-5cfdd6be9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acb0700-a939-4852-8698-9f4b02ae5124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acb0700-a939-4852-8698-9f4b02ae5124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416038361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b4fdce-99a0-4ad8-92a7-8b03276030eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:08Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00259630-6e77-4168-9cc4-6c1ac431c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00259630-6e77-4168-9cc4-6c1ac431c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ee23bc-dab7-42a8-9860-1e53854b23f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ee23bc-dab7-42a8-9860-1e53854b23f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b4fdce-99a0-4ad8-92a7-8b03276030eb', 'volume_name': 'volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e2831c-673d-43af-9d09-5556162b0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e2831c-673d-43af-9d09-5556162b0a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe74ce-416b-45f3-80c1-698d5e1fe5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume d9b4fdce-99a0-4ad8-92a7-8b03276030eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb', 'volume_size': 1} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:08 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (0be30460-62a3-4c19-a6da-7fcc4e18fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc879d-d005-46b7-8135-03df91d9967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 1G" returned: 0 in 1.428s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cc879d-d005-46b7-8135-03df91d9967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413265646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f422cedd-bb89-41cb-8216-c3b8d7956623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:09Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a39a1-e284-4306-be79-51655c01f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a39a1-e284-4306-be79-51655c01f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc50764-f6e8-491b-929b-be950e35b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc50764-f6e8-491b-929b-be950e35b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f422cedd-bb89-41cb-8216-c3b8d7956623', 'volume_name': 'volume-f422cedd-bb89-41cb-8216-c3b8d7956623', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:08 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17b0985-b3a3-4537-b970-340dab29b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17b0985-b3a3-4537-b970-340dab29b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cfb132-d796-4f0f-98a4-b483773508d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:08 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume f422cedd-bb89-41cb-8216-c3b8d7956623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f422cedd-bb89-41cb-8216-c3b8d7956623', 'volume_size': 1} Apr 28 16:18:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (0ea62f3c-d58e-45d0-8587-500a634e35a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5879e0e1-157b-4c21-93cc-e708185b8dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5879e0e1-157b-4c21-93cc-e708185b8dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349613095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:09Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322cfbf9-29d0-4ce5-829f-b05808318af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322cfbf9-29d0-4ce5-829f-b05808318af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f082687-134e-42e1-a27b-5c8fbaaa8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f082687-134e-42e1-a27b-5c8fbaaa8eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc', 'volume_name': 'volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efabaeea-b4e6-4f07-8a28-ec919a35b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efabaeea-b4e6-4f07-8a28-ec919a35b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b5d830-5ddb-4511-843c-c200ae98852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:09 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume 884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc', 'volume_size': 1} Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:09 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.943s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:09 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 is being set with open permissions: ugo+rw Apr 28 16:18:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:09 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:09 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:10 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.669s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:10 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info Apr 28 16:18:10 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:11 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info" returned: 0 in 0.640s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:11 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info is being set with open permissions: ugo+rw Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:11 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info Apr 28 16:18:11 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:11 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.info" returned: 0 in 0.695s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] snapshot: f10abce7-c6d9-4447-895e-945ee7759625, volume: 16001268-2218-456b-af17-7b06b3a6e0ce, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8203715-c53e-4c4b-b65b-3dc210ce6580]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:12 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:12 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:12 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.784s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7543b5-d4d8-42d2-be03-8bd913473adf]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:12 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:12 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:13 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:13 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:18:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:13 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce Apr 28 16:18:13 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Flow 'volume_create_manager' (78f24d34-7f33-4c3f-bf9f-5c828015853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a83c2c-2d39-4f44-9d81-995859ae05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a83c2c-2d39-4f44-9d81-995859ae05d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2017593127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6737db53792b4af0b9acebcf92035c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:15Z,use_quota=True,user_id='71e808ffa2dc4481a590311bdbf9f802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4253fb-418d-4bab-821e-ca38878dd34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4253fb-418d-4bab-821e-ca38878dd34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46061f01-7111-4025-b803-3c7b7caebc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46061f01-7111-4025-b803-3c7b7caebc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6', 'volume_name': 'volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e66f353-c192-4793-b46d-011c706103bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e66f353-c192-4793-b46d-011c706103bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f9ce6a-793a-48f2-87f0-8c9d9b6c1893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6', 'volume_size': 1} Apr 28 16:18:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:19 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce" returned: 0 in 5.580s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:19 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac4a7f-8fd6-4b15-bf43-cbe040ec8dee]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:19 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:19 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:20 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 0.903s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:18:20 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Converted 1024.00 MB image at 183.49 MB/s Apr 28 16:18:20 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce is being set with open permissions: ugo+rw Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:20 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce Apr 28 16:18:20 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:20 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce" returned: 0 in 0.630s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" released by "_copy_volume_from_snapshot" :: held 8.912s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-f10abce7-c6d9-4447-895e-945ee7759625" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-f10abce7-c6d9-4447-895e-945ee7759625" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Deleting offline snapshot f10abce7-c6d9-4447-895e-945ee7759625 of volume 38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] snapshot_file for this snap is: volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaac156-ec87-4327-8d7f-1cb19e04d07a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:20 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:20 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:21 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.841s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:18:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4d2f66-0370-46cb-b4ec-a8a671eafbd9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:21 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:21 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:22 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 0.733s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:22 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:22 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:23 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.734s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:23 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625 Apr 28 16:18:23 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:23 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1.f10abce7-c6d9-4447-895e-945ee7759625" returned: 0 in 0.657s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-f10abce7-c6d9-4447-895e-945ee7759625" released by "_delete_snapshot" :: held 3.082s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.612s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.631s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-227526444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516c81e6-4545-404b-ba0d-6f03c1e929fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:07Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume 516c81e6-4545-404b-ba0d-6f03c1e929fc {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:23 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541d8ddd-0c2e-4526-8fd7-7a1e5a04dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16001268-2218-456b-af17-7b06b3a6e0ce', 'volume_size': 1, 'source_volid': '38f693c3-6bc3-458a-b8b5-cbc72b087ec1', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:23 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc 1073741824 Apr 28 16:18:23 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552bd878-f9f7-4a3f-8098-9ef188b989c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Volume volume-16001268-2218-456b-af17-7b06b3a6e0ce (16001268-2218-456b-af17-7b06b3a6e0ce): created successfully Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552bd878-f9f7-4a3f-8098-9ef188b989c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (ab6f0778-cfbb-4b68-b7b6-9c8abdcf13d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2e396a48-715a-4840-9788-5714aa2e1319 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:18:24 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc 1073741824" returned: 0 in 0.902s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:24 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc Apr 28 16:18:24 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:25 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc" returned: 0 in 0.711s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.673s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42079797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5059be-776c-4980-bac0-1858ef17f6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:08Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume 4b5059be-776c-4980-bac0-1858ef17f6f6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ca4482-c761-41d5-8655-a4bad96d583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516c81e6-4545-404b-ba0d-6f03c1e929fc', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 1073741824 Apr 28 16:18:25 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d929a3-a5ab-4d67-b7eb-6006ed534107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-516c81e6-4545-404b-ba0d-6f03c1e929fc (516c81e6-4545-404b-ba0d-6f03c1e929fc): created successfully Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d929a3-a5ab-4d67-b7eb-6006ed534107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (895832cb-6156-48e8-9ca7-b0f2a5457a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-84d4dc94-dd92-4ec6-a09e-2fc9aa7dc1d8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (b67c891e-617e-49eb-8193-58cbadf21037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73083715-8c20-43e5-9e17-1ad0f267a662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73083715-8c20-43e5-9e17-1ad0f267a662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-865757163',display_name='tempest-VolumesGetTest-Volume-845956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf34f85-6b9f-4262-b736-225475fde012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:26Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb926692-e8a3-4063-9bd2-18c303fa2a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb926692-e8a3-4063-9bd2-18c303fa2a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c985a43d-4344-4135-b9db-154e6a210b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c985a43d-4344-4135-b9db-154e6a210b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf34f85-6b9f-4262-b736-225475fde012', 'volume_name': 'volume-adf34f85-6b9f-4262-b736-225475fde012', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9b942c-04fc-49f5-b7cb-2848ee5df3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9b942c-04fc-49f5-b7cb-2848ee5df3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e757cb8-fbfe-47a4-ba61-89750518e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Volume adf34f85-6b9f-4262-b736-225475fde012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf34f85-6b9f-4262-b736-225475fde012', 'volume_size': 1} Apr 28 16:18:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:26 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 1073741824" returned: 0 in 0.991s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:26 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 Apr 28 16:18:26 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:27 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6" returned: 0 in 0.639s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.048s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416038361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b4fdce-99a0-4ad8-92a7-8b03276030eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:08Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume d9b4fdce-99a0-4ad8-92a7-8b03276030eb {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:27 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:27 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb 1073741824 Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399986fe-801e-47c9-8e9f-5b1e12a49d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5059be-776c-4980-bac0-1858ef17f6f6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:27 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9863db90-da64-4369-ae2e-14c78dc6516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-4b5059be-776c-4980-bac0-1858ef17f6f6 (4b5059be-776c-4980-bac0-1858ef17f6f6): created successfully Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9863db90-da64-4369-ae2e-14c78dc6516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (8efcbb0a-6a24-4e82-82f8-ef524e792695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-965e2f6b-05ac-4baf-aea3-4fbea1c271d4 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:28 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb 1073741824" returned: 0 in 0.930s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:28 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb Apr 28 16:18:28 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:28 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" returned: 0 in 0.630s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413265646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f422cedd-bb89-41cb-8216-c3b8d7956623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:09Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume f422cedd-bb89-41cb-8216-c3b8d7956623 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:28 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fe74ce-416b-45f3-80c1-698d5e1fe5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:28 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 1073741824 Apr 28 16:18:28 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5806e-bdea-41d0-8942-5bf511a3d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:28 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb (d9b4fdce-99a0-4ad8-92a7-8b03276030eb): created successfully Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5806e-bdea-41d0-8942-5bf511a3d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (a15382f7-0496-43ca-a074-5cfdd6be9989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:28 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8bba8a98-c5ab-4963-9c8e-1833c22619e7 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Flow 'volume_create_manager' (6e4ae438-fd66-4903-a6ea-a4e8f24b28a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9657774-5f50-4f08-9cdc-8515ffbe5df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9657774-5f50-4f08-9cdc-8515ffbe5df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-690592829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e225fe26-906e-4d27-b250-2195bef66750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089fda09953c4b4b982b96dea6739b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:29Z,use_quota=True,user_id='c233ed3d2c0342279144d78e5be9af07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f43e63-5b38-498f-a0ac-6d38f372f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f43e63-5b38-498f-a0ac-6d38f372f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1660fb-0f12-43e3-81e1-cd606df68c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1660fb-0f12-43e3-81e1-cd606df68c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e225fe26-906e-4d27-b250-2195bef66750', 'volume_name': 'volume-e225fe26-906e-4d27-b250-2195bef66750', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b72554-e0ed-4dd0-9db1-641dbfd535a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b72554-e0ed-4dd0-9db1-641dbfd535a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ae64d7-0c9c-481b-9956-6426a2f0bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:29 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Volume e225fe26-906e-4d27-b250-2195bef66750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e225fe26-906e-4d27-b250-2195bef66750', 'volume_size': 1} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:29 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 1073741824" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:29 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 Apr 28 16:18:29 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:30 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623" returned: 0 in 0.618s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.848s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349613095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a167ccbf14e04e539ea34b738bc61452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:09Z,use_quota=True,user_id='cbe1b546fc344ec2bdfd646b0f43cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Creating volume 884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:30 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90cfb132-d796-4f0f-98a4-b483773508d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f422cedd-bb89-41cb-8216-c3b8d7956623', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b119a97f-87ad-46f7-b1c9-5b4121f7c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:30 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc 1073741824 Apr 28 16:18:30 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:30 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-f422cedd-bb89-41cb-8216-c3b8d7956623 (f422cedd-bb89-41cb-8216-c3b8d7956623): created successfully Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b119a97f-87ad-46f7-b1c9-5b4121f7c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:30 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (0be30460-62a3-4c19-a6da-7fcc4e18fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-72764312-fab4-4716-b61c-c27c38aab333 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:31 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc 1073741824" returned: 0 in 0.772s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:31 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc Apr 28 16:18:31 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:31 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" returned: 0 in 0.577s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.693s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2017593127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6737db53792b4af0b9acebcf92035c23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:15Z,use_quota=True,user_id='71e808ffa2dc4481a590311bdbf9f802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Creating volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:31 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:31 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 1073741824 Apr 28 16:18:31 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b5d830-5ddb-4511-843c-c200ae98852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dacb52-2016-4df7-9d02-230aec62c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:31 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Volume volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc (884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc): created successfully Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dacb52-2016-4df7-9d02-230aec62c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Flow 'volume_create_manager' (0ea62f3c-d58e-45d0-8587-500a634e35a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:31 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4fcb25b4-8693-4d50-9d5e-a2fcce89a990 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created volume successfully. Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:32 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 1073741824" returned: 0 in 0.845s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0d0ac8-4959-4f83-bf85-22330fbc96ba]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:32 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:18:32 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:32 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc Apr 28 16:18:32 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:33 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.642s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.364s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-865757163',display_name='tempest-VolumesGetTest-Volume-845956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf34f85-6b9f-4262-b736-225475fde012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:26Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Creating volume adf34f85-6b9f-4262-b736-225475fde012 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:33 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f9ce6a-793a-48f2-87f0-8c9d9b6c1893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f99e9b-e7b9-493a-807b-65f67109df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:33 devstack sudo[91525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 1073741824 Apr 28 16:18:33 devstack sudo[91525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:33 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Volume volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 (11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6): created successfully Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f99e9b-e7b9-493a-807b-65f67109df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Flow 'volume_create_manager' (78f24d34-7f33-4c3f-bf9f-5c828015853d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c03f790f-0446-4660-8909-d0c00b467e59 tempest-VolumesActionsTest-1391775164 None] Created volume successfully. Apr 28 16:18:33 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" returned: 0 in 0.821s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:33 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc Apr 28 16:18:33 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:34 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" returned: 0 in 0.672s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc" released by "delete_volume" :: held 1.559s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:34 devstack sudo[91525]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 1073741824" returned: 0 in 0.895s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['f25aad6c-4930-4a01-b35e-49091d4d006b', 'c710792a-55fb-4677-af82-cc2c3d9f2c57', 'c98ed14b-9f6d-434d-b932-a2d9229477c0', '9fbc3bfb-ffeb-4c36-bfc5-80434479ea7a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:34 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 Apr 28 16:18:34 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:34 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:34 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-f422cedd-bb89-41cb-8216-c3b8d7956623-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-f422cedd-bb89-41cb-8216-c3b8d7956623-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-f422cedd-bb89-41cb-8216-c3b8d7956623" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-f422cedd-bb89-41cb-8216-c3b8d7956623" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:34 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012" returned: 0 in 0.667s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.577s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-690592829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e225fe26-906e-4d27-b250-2195bef66750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089fda09953c4b4b982b96dea6739b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:29Z,use_quota=True,user_id='c233ed3d2c0342279144d78e5be9af07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Creating volume e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:34 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[208400f8-d190-4fd4-8fbb-3454f6736336]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:34 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 1073741824 Apr 28 16:18:34 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e757cb8-fbfe-47a4-ba61-89750518e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf34f85-6b9f-4262-b736-225475fde012', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba9c769-c11f-4e7a-bb46-8b6e241a50df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Volume volume-adf34f85-6b9f-4262-b736-225475fde012 (adf34f85-6b9f-4262-b736-225475fde012): created successfully Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba9c769-c11f-4e7a-bb46-8b6e241a50df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (b67c891e-617e-49eb-8193-58cbadf21037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1dee9eb9-7f88-4172-a8e8-ae9991abcf19 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:18:35 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 Apr 28 16:18:35 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:35 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.808s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bfccd305-ef36-4a0e-af46-5100a422dc23 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-884fa36f-a1f5-49ac-a1d6-5efbdc6de5bc-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-adf34f85-6b9f-4262-b736-225475fde012-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "cinder-adf34f85-6b9f-4262-b736-225475fde012-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-adf34f85-6b9f-4262-b736-225475fde012" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-adf34f85-6b9f-4262-b736-225475fde012" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29655de-c3dd-40d0-9005-0eb47f801122]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:35 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 Apr 28 16:18:35 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:35 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623" returned: 0 in 1.044s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:36 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 1073741824" returned: 0 in 1.073s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:36 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623 Apr 28 16:18:36 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:36 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:18:36 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:36 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012" returned: 0 in 0.841s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:36 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012 Apr 28 16:18:36 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:36 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f422cedd-bb89-41cb-8216-c3b8d7956623" returned: 0 in 0.712s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-f422cedd-bb89-41cb-8216-c3b8d7956623" released by "delete_volume" :: held 1.831s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:36 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.768s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['1758d4a0-d11f-47c0-b7f0-fb84775180b8', '02582235-0627-4fce-9247-c791ea42e705', '5f21f802-ea29-4ef8-a324-26eeac0447c0', '73dfc78c-f7a6-407c-9f40-7e7a20302331'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ae64d7-0c9c-481b-9956-6426a2f0bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e225fe26-906e-4d27-b250-2195bef66750', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc79fad5-4de0-4dc6-8e60-51a1c2dd44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Volume volume-e225fe26-906e-4d27-b250-2195bef66750 (e225fe26-906e-4d27-b250-2195bef66750): created successfully Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc79fad5-4de0-4dc6-8e60-51a1c2dd44d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Flow 'volume_create_manager' (6e4ae438-fd66-4903-a6ea-a4e8f24b28a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7f50eb34-9605-44a2-94ef-da9fec098a02 tempest-SnapshotDependencyTests-405802158 None] Created volume successfully. Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:36 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:36 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-d9b4fdce-99a0-4ad8-92a7-8b03276030eb-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-d9b4fdce-99a0-4ad8-92a7-8b03276030eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b38ace-2f44-4f1a-9c83-5e5c406ccbcd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:37 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-adf34f85-6b9f-4262-b736-225475fde012" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-adf34f85-6b9f-4262-b736-225475fde012" released by "delete_volume" :: held 1.617s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Created reservations ['4f790fab-dc79-49b1-bf77-5e67b041b52c', '97aa4b0c-8c3c-496a-9fa9-d998f6fb7670', '541d696f-9d20-4a2f-952b-a88625a824be', '1b0cd177-c122-4af2-9785-b3bc4f253ffb'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:37 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb Apr 28 16:18:37 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:37 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:37 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:37 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.738s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c3eafc5f-a2c1-44ad-99aa-b7d56c06eea1 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-f422cedd-bb89-41cb-8216-c3b8d7956623-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-16001268-2218-456b-af17-7b06b3a6e0ce-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "cinder-16001268-2218-456b-af17-7b06b3a6e0ce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:38 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" returned: 0 in 0.870s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8780aa0-5d2f-4887-a47f-053e26b247a8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:38 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.779s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:38 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:38 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-89454e86-2260-4059-829e-ffe5a300c527 tempest-VolumesGetTest-252979578 None] Lock "cinder-adf34f85-6b9f-4262-b736-225475fde012-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Creating offline snapshot 40798c3e-657a-4da9-b959-755b4b60bf16 of volume e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24268a1-c9bf-41eb-a178-c99f3f9b3466]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:38 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce Apr 28 16:18:38 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:38 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:18:38 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:38 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" returned: 0 in 0.724s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-d9b4fdce-99a0-4ad8-92a7-8b03276030eb" released by "delete_volume" :: held 1.659s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['17f72e96-9576-46c5-b8f3-d33df5aa6698', '32ef3cd0-738b-4931-9d0a-023406c45ebf', 'e7f8d1ff-8736-4875-a570-31c7f7fc7613', 'a23044ae-c6a2-41f1-b227-187ceb25830a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:38 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce" returned: 0 in 0.834s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:38 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce Apr 28 16:18:38 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:38 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:38 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:39 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.834s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:39 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 1G Apr 28 16:18:39 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-4b5059be-776c-4980-bac0-1858ef17f6f6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-4b5059be-776c-4980-bac0-1858ef17f6f6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-4b5059be-776c-4980-bac0-1858ef17f6f6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-4b5059be-776c-4980-bac0-1858ef17f6f6" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a783e9-a7c8-4330-b4fd-1581aa5ce5bd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:39 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-16001268-2218-456b-af17-7b06b3a6e0ce" returned: 0 in 0.672s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:39 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.653s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-16001268-2218-456b-af17-7b06b3a6e0ce" released by "delete_volume" :: held 1.578s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:39 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 Apr 28 16:18:39 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e7d6ade5-4df0-4eec-be59-f3ffbbb6fd99 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-d9b4fdce-99a0-4ad8-92a7-8b03276030eb-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Created reservations ['66feb552-e83a-4b71-8a16-cca2efd25207', '4259c67a-7c8b-4af4-9057-570be3d925ff', '32b8e6b3-573d-408f-adb4-1bcf6d6e761e', '8994695e-f34e-4116-bdc8-c23d70419d89'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:39 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:39 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:39 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 1G" returned: 0 in 0.904s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e225fe26-906e-4d27-b250-2195bef66750 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:39 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e225fe26-906e-4d27-b250-2195bef66750 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:39 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-38f693c3-6bc3-458a-b8b5-cbc72b087ec1-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "cinder-38f693c3-6bc3-458a-b8b5-cbc72b087ec1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb116b92-7255-4587-aa9e-778e9fbf76e3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:40 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:40 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6" returned: 0 in 0.990s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:40 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:18:40 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6 Apr 28 16:18:40 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5ebbfad-c814-4f0d-b5b8-a38d959348ac tempest-VolumesGetTest-252979578 None] Lock "cinder-16001268-2218-456b-af17-7b06b3a6e0ce-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:40 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:40 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:40 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e225fe26-906e-4d27-b250-2195bef66750 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 0.773s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:40 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 is being set with open permissions: ugo+rw Apr 28 16:18:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:40 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:40 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:41 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b5059be-776c-4980-bac0-1858ef17f6f6" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-4b5059be-776c-4980-bac0-1858ef17f6f6" released by "delete_volume" :: held 1.885s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:41 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 1.013s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['05a8a340-9f74-40e0-88ea-d8cee399cd4b', '96d0c36d-4e94-4e03-97e2-8178c7c56353', 'f084f369-6249-47fa-aba8-158eebfd1e0a', '4a097a85-f1eb-4199-8653-e2eff0ac9ea7'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:41 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1 Apr 28 16:18:41 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:41 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:41 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:41 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 1.011s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-516c81e6-4545-404b-ba0d-6f03c1e929fc-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-516c81e6-4545-404b-ba0d-6f03c1e929fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-516c81e6-4545-404b-ba0d-6f03c1e929fc" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:41 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info Apr 28 16:18:41 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-516c81e6-4545-404b-ba0d-6f03c1e929fc" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78d30ec-bcf7-4248-889f-e4616a6507d8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:42 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc Apr 28 16:18:42 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:42 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.839s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8e1caa71-03c5-4b98-8483-58a1fa7d7b7a tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-4b5059be-776c-4980-bac0-1858ef17f6f6-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:42 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info" returned: 0 in 0.812s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:42 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info is being set with open permissions: ugo+rw Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:42 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" returned: 0 in 1.239s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:42 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info Apr 28 16:18:42 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-38f693c3-6bc3-458a-b8b5-cbc72b087ec1" released by "delete_volume" :: held 2.351s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Created reservations ['a6808bad-85f3-40d8-a8ef-7a2d44c942c5', '2c17c75d-24b2-48c1-a4ed-0dad9a3889e5', '68d433b2-4bde-45b8-a67e-2259fe96330f', '3388ae9b-c75d-489d-93b3-e0e8abdc85cc'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:42 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc" returned: 0 in 1.010s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:42 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:42 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:43 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:43 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:43 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.info" returned: 0 in 0.986s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.472s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9a8a38e6-9bf2-46e8-970b-a241cecfcfbe tempest-SnapshotDependencyTests-405802158 None] Create snapshot completed successfully Apr 28 16:18:43 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.767s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:18:43 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9db1d463-a987-438b-99e5-8fbe5ee8cabd tempest-VolumesGetTest-252979578 None] Lock "cinder-38f693c3-6bc3-458a-b8b5-cbc72b087ec1-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-516c81e6-4545-404b-ba0d-6f03c1e929fc" returned: 0 in 0.892s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-516c81e6-4545-404b-ba0d-6f03c1e929fc" released by "delete_volume" :: held 1.962s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['9a4db4f5-7bac-44ee-a70f-223110ad6cca', 'd9dd0897-f6de-4e7b-ab44-e9350a0fae1f', 'b1b67fa7-3275-4603-aade-5bf4f23458c0', 'f155bf7b-59cc-4dd0-9631-dd5ec3a5ebbb'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:43 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:43 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-d2e193be-afff-483e-9d61-0b43c44010c5-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-d2e193be-afff-483e-9d61-0b43c44010c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "cinder-quobyte-d2e193be-afff-483e-9d61-0b43c44010c5" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-d2e193be-afff-483e-9d61-0b43c44010c5" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[81707a2b-0148-4b08-b1f9-409da68e6dd1]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:44 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 Apr 28 16:18:44 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:44 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.722s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (38fb3be1-30ab-4b64-9eea-325e92178061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d43d0a8-af10-49d4-a833-fbf08d924c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-00bb17f7-d7d9-4242-9183-4f3b031f09f8 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-516c81e6-4545-404b-ba0d-6f03c1e929fc-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d43d0a8-af10-49d4-a833-fbf08d924c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-63265792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e91d68b-8efa-4ac8-b919-fd5cda682e64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:45Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20694d2f-9e76-4421-aa94-6859d597ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20694d2f-9e76-4421-aa94-6859d597ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7741f3-fa4c-4587-8cd7-d0db732728db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:44 devstack cinder-volume[84171]: DEBUG cinder.image.glance [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Creating Keystone auth plugin from conf {{(pid=84171) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 16:18:45 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5" returned: 0 in 0.921s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:45 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5 Apr 28 16:18:45 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Flow 'volume_create_manager' (a2cf5218-2c50-4962-91f6-8fecee4d73e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1fe4a-7bd3-498b-ba26-0d71de7a6412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=126,cinder:INSERT=51,cinder:UPDATE=207,cinder:DELETE=17 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1fe4a-7bd3-498b-ba26-0d71de7a6412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97b8aee-5f09-4432-81e1-3dbcdaf8c42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='089fda09953c4b4b982b96dea6739b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40798c3e-657a-4da9-b959-755b4b60bf16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:45Z,use_quota=True,user_id='c233ed3d2c0342279144d78e5be9af07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e88d4f-a0fc-4014-a1b4-bbfe29c1dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e88d4f-a0fc-4014-a1b4-bbfe29c1dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d26248-9884-42ba-a307-16e832b91aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d26248-9884-42ba-a307-16e832b91aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd97b8aee-5f09-4432-81e1-3dbcdaf8c42e', 'volume_name': 'volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e', 'volume_size': 1, 'snapshot_id': '40798c3e-657a-4da9-b959-755b4b60bf16'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2279bd-5542-4bcc-812a-1f13080b0001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2279bd-5542-4bcc-812a-1f13080b0001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0a0ba7-0b17-4650-bc6b-cb615aa95c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Volume d97b8aee-5f09-4432-81e1-3dbcdaf8c42e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e', 'volume_size': 1, 'snapshot_id': '40798c3e-657a-4da9-b959-755b4b60bf16'} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7741f3-fa4c-4587-8cd7-d0db732728db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e91d68b-8efa-4ac8-b919-fd5cda682e64', 'volume_name': 'volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c70b02-b7ca-4de9-a8e4-d6ea59a47931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c70b02-b7ca-4de9-a8e4-d6ea59a47931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9cc491-bf99-4082-801f-3eff9cbf5e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:45 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Trying to clone 2e91d68b-8efa-4ac8-b919-fd5cda682e64 from image 15a518ba-55ac-48ec-8b87-111778c54a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]). {{(pid=84171) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Creating volume d97b8aee-5f09-4432-81e1-3dbcdaf8c42e from snapshot 40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] snapshot: 40798c3e-657a-4da9-b959-755b4b60bf16, volume: d97b8aee-5f09-4432-81e1-3dbcdaf8c42e, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc4b343-33bc-408c-9c60-f3c1220e52ad]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:45 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:45 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 16:18:45 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Image download 20.69 MB at 20.69 MB/s Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b633870-163b-4490-93a6-09f2ad548eba]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:45 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d2e193be-afff-483e-9d61-0b43c44010c5" returned: 0 in 0.789s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-quobyte-d2e193be-afff-483e-9d61-0b43c44010c5" released by "delete_volume" :: held 1.780s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:45 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD Apr 28 16:18:45 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:45 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Created reservations ['95a1d881-fed7-45af-b0e5-7b83f3659b72', 'ec9fe37b-4520-420a-b068-848d320cf21a', '47971a93-dc28-484b-8184-e24ede435a03', 'dd9c8625-b267-40a7-bbbe-00aa9dacae6f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:46 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:18:46 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:46 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 0.886s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e225fe26-906e-4d27-b250-2195bef66750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4522c6-5c6c-46bd-a85c-ee9d59044ac5]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:46 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:18:46 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:46 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD" returned: 0 in 0.834s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b is fetched for user 207afb9b36974203a14f8bf954bd84d3. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 16:18:46 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bdb93a-8241-46ea-9d44-ea0451f9ef6a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.678s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:18:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Deleted volume successfully. Apr 28 16:18:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1078402c-f986-40ee-a384-1da7c7faf7a0 tempest-CreateVolumesFromSourceVolumeTest-441328573 None] Lock "cinder-d2e193be-afff-483e-9d61-0b43c44010c5-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:46 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD Apr 28 16:18:46 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:47 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.948s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:47 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:18:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:47 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e Apr 28 16:18:47 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:47 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=142,cinder:UPDATE=175,cinder:INSERT=45,cinder:DELETE=14 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (b2547558-6bf5-4e6b-91be-9b1b4912604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27179ba1-7bcb-4963-963c-804b0729f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27179ba1-7bcb-4963-963c-804b0729f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1917000810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30357a5-2903-4d27-bdf7-eecc09093489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:53Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bcb21f-8994-4ece-92da-182da2382a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bcb21f-8994-4ece-92da-182da2382a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df0fa29-085c-4ef2-8ffc-c03c6bdd2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df0fa29-085c-4ef2-8ffc-c03c6bdd2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30357a5-2903-4d27-bdf7-eecc09093489', 'volume_name': 'volume-d30357a5-2903-4d27-bdf7-eecc09093489', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7191cb-5ea7-4a62-a11c-4e24fbe04634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7191cb-5ea7-4a62-a11c-4e24fbe04634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd52c03-4872-4ca9-8d9e-c9fe3d57f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:53 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Volume d30357a5-2903-4d27-bdf7-eecc09093489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30357a5-2903-4d27-bdf7-eecc09093489', 'volume_size': 1} Apr 28 16:18:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:54 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" returned: 0 in 7.386s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d96ad1b-c7fb-4c42-a21f-7fd57ca51f65]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:54 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:18:54 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-67cf697b-6413-4400-804f-07e6a0af2b9a tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" by "attach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-67cf697b-6413-4400-804f-07e6a0af2b9a tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" acquired by "attach_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-67cf697b-6413-4400-804f-07e6a0af2b9a tempest-VolumesActionsTest-1391775164 None] Attaching volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 to instance 2a1b0c45-5633-46ba-92df-86893af04292 at mountpoint /dev/vdb on host None. Apr 28 16:18:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-67cf697b-6413-4400-804f-07e6a0af2b9a tempest-VolumesActionsTest-1391775164 None] Attach volume completed successfully. Apr 28 16:18:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-67cf697b-6413-4400-804f-07e6a0af2b9a tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" released by "attach_volume" :: held 0.096s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5c5f3179-6748-42f4-85bc-1f9ea3726667 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" by "detach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5c5f3179-6748-42f4-85bc-1f9ea3726667 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5c5f3179-6748-42f4-85bc-1f9ea3726667 tempest-VolumesActionsTest-1391775164 None] Detaching volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 from instance 2a1b0c45-5633-46ba-92df-86893af04292. Apr 28 16:18:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5c5f3179-6748-42f4-85bc-1f9ea3726667 tempest-VolumesActionsTest-1391775164 None] Detach volume completed successfully. Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5c5f3179-6748-42f4-85bc-1f9ea3726667 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:55 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.957s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:18:55 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Converted 1024.00 MB image at 138.62 MB/s Apr 28 16:18:55 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e is being set with open permissions: ugo+rw Apr 28 16:18:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:55 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e Apr 28 16:18:55 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:56 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" returned: 0 in 0.612s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" released by "_copy_volume_from_snapshot" :: held 10.944s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" released by "_create_volume_from_snapshot" :: held 10.975s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.016s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.742s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-63265792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e91d68b-8efa-4ac8-b919-fd5cda682e64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:45Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Creating volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:56 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:56 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1073741824 Apr 28 16:18:56 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0a0ba7-0b17-4650-bc6b-cb615aa95c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e', 'volume_size': 1, 'snapshot_id': '40798c3e-657a-4da9-b959-755b4b60bf16'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb83dce1-7a56-4589-b6f5-8ed77f1800b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:56 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Volume volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e (d97b8aee-5f09-4432-81e1-3dbcdaf8c42e): created successfully Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb83dce1-7a56-4589-b6f5-8ed77f1800b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Flow 'volume_create_manager' (a2cf5218-2c50-4962-91f6-8fecee4d73e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:18:56 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-340b072c-bdf5-4e22-a148-a5aa02cbe765 tempest-SnapshotDependencyTests-405802158 None] Created volume successfully. Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-40798c3e-657a-4da9-b959-755b4b60bf16-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-40798c3e-657a-4da9-b959-755b4b60bf16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Deleting offline snapshot 40798c3e-657a-4da9-b959-755b4b60bf16 of volume e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] snapshot_file for this snap is: volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7131b4-7e03-4b8e-828f-6690e9c84202]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:56 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:56 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:57 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1073741824" returned: 0 in 0.883s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:57 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:18:57 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:57 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 0.996s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e225fe26-906e-4d27-b250-2195bef66750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cbb2e7-306b-4a82-9737-7c9e53d34cb5]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:57 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:18:57 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:58 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 0 in 0.820s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1917000810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30357a5-2903-4d27-bdf7-eecc09093489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:18:53Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Creating volume d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:18:58 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:58 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 1073741824 Apr 28 16:18:58 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Attempting download of 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26f05b-6cae-4763-981f-a9fff75d3f24]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:58 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d Apr 28 16:18:58 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:58 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.842s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:58 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:58 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:59 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d" returned: 0 in 0.802s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:59 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 1073741824" returned: 0 in 0.939s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:59 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:18:59 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:59 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d Apr 28 16:18:59 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:59 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 0.873s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:18:59 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16 Apr 28 16:18:59 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:18:59 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 0.828s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd52c03-4872-4ca9-8d9e-c9fe3d57f71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30357a5-2903-4d27-bdf7-eecc09093489', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36b04bb-6e94-4512-a9b1-85bc64930037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:18:59 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Apr 28 16:18:59 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Volume volume-d30357a5-2903-4d27-bdf7-eecc09093489 (d30357a5-2903-4d27-bdf7-eecc09093489): created successfully Apr 28 16:18:59 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36b04bb-6e94-4512-a9b1-85bc64930037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (b2547558-6bf5-4e6b-91be-9b1b4912604a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d" returned: 1 in 1.000s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15a518ba-55ac-48ec-8b87-111778c54a6b_a5cu8a8d' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b847d5-aa38-46e1-b019-cd4e9c00f705]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:00 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9dde428a-b199-4d88-972a-ef01e196d735 tempest-VolumeDependencyTests-1892661892 None] Created volume successfully. Apr 28 16:19:00 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD Apr 28 16:19:00 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:00 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750.40798c3e-657a-4da9-b959-755b4b60bf16" returned: 0 in 0.637s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-40798c3e-657a-4da9-b959-755b4b60bf16" released by "_delete_snapshot" :: held 3.487s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" released by "delete_snapshot" :: held 3.514s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Created reservations ['090e62c1-4d62-4357-9b60-21db4f173a06', '30bb1f57-bbb0-451d-94b3-f90055836f0c', '0dec8916-6325-4f2e-91b0-97cb999392a6', '3caed187-740c-46f5-b0ce-ba287911e3fa'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:00 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Delete snapshot completed successfully. Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58a469c5-e511-4cad-99b5-9a4b8d0969f2 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-40798c3e-657a-4da9-b959-755b4b60bf16-delete_snapshot" released by "delete_snapshot" :: held 3.706s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:00 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:00 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:00 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD" returned: 0 in 0.722s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] 15a518ba-55ac-48ec-8b87-111778c54a6b was qcow2, converting to raw {{(pid=84171) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 16:19:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:00 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:00 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-e225fe26-906e-4d27-b250-2195bef66750-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Creating offline snapshot 9d3a3bca-7c7f-4efe-b232-177c4d6ef77b of volume d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-e225fe26-906e-4d27-b250-2195bef66750-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d4ec03-c240-415f-94d5-5cb263f10a4b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[260b01d6-6269-4739-b2d5-0f21a803f267]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:01 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:01 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:01 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:19:01 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:01 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.775s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:02 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 0.938s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:02 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b 1G Apr 28 16:19:02 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:02 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.894s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:02 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750 Apr 28 16:19:02 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:02 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-e225fe26-906e-4d27-b250-2195bef66750" returned: 0 in 0.702s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-e225fe26-906e-4d27-b250-2195bef66750" released by "delete_volume" :: held 1.667s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Created reservations ['5e0f5783-ceb7-4f06-82ab-0a2631f01de0', '8bd2e258-083b-48de-bff5-2f17e2bb69b4', '512a155d-e10a-4045-b5b6-df26495bf6c5', '53b248ce-0869-4d69-adb7-098b623a595e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:02 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b 1G" returned: 0 in 0.888s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30357a5-2903-4d27-bdf7-eecc09093489 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:02 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30357a5-2903-4d27-bdf7-eecc09093489 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:02 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:03 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:03 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:03 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 0 in 2.257s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15a518ba-55ac-48ec-8b87-111778c54a6b_cv1zsyhwdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:19:03 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Converted 112.00 MB image at 49.59 MB/s Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:03 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1G Apr 28 16:19:03 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bffe10-7680-48b7-9982-ed20eb526eef]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:03 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e Apr 28 16:19:03 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:03 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.684s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Deleted volume successfully. Apr 28 16:19:03 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30357a5-2903-4d27-bdf7-eecc09093489 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:03 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b is being set with open permissions: ugo+rw Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4a0eaefc-c244-420a-9c16-5bed8425bf3c tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-e225fe26-906e-4d27-b250-2195bef66750-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:03 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:03 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:03 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 1G" returned: 0 in 0.811s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76840d6-67e5-4943-8c68-62747c7cfb8a]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:03 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:03 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:04 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" returned: 0 in 0.868s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:04 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e Apr 28 16:19:04 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:04 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.684s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:04 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info Apr 28 16:19:04 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:04 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 0 in 0.777s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:04 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:04 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:05 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" returned: 0 in 0.830s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-quobyte-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e" released by "delete_volume" :: held 1.753s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:05 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info" returned: 0 in 0.794s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:05 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info is being set with open permissions: ugo+rw Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Created reservations ['d80fe454-fce6-423b-80aa-b39be0970c8f', 'd8d3c974-ec06-4813-a67e-20d3fc3ec467', '2404138c-a417-4546-8ab1-ad3b14b5efd6', '3a330804-cb6f-4cf3-8fa9-4353f4e4642f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:05 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info Apr 28 16:19:05 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:05 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:05 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:05 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 1 in 1.001s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Downloaded image 15a518ba-55ac-48ec-8b87-111778c54a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}])) to volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64 successfully. {{(pid=84171) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Temporary image 15a518ba-55ac-48ec-8b87-111778c54a6b for user 207afb9b36974203a14f8bf954bd84d3 is deleted. {{(pid=84171) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.volume_utils [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Marking volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64 as bootable. {{(pid=84171) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Copying metadata from image 15a518ba-55ac-48ec-8b87-111778c54a6b to 2e91d68b-8efa-4ac8-b919-fd5cda682e64. {{(pid=84171) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Creating volume glance metadata for volume 2e91d68b-8efa-4ac8-b919-fd5cda682e64 backed by image 15a518ba-55ac-48ec-8b87-111778c54a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84171) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9cc491-bf99-4082-801f-3eff9cbf5e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64', 'volume_size': 1, 'image_id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15a518ba-55ac-48ec-8b87-111778c54a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee656501bf0f4d5db15d689834f60f8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '15a518ba-55ac-48ec-8b87-111778c54a6b', 'created_at': datetime.datetime(2026, 4, 28, 14, 5, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 14, 5, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15a518ba-55ac-48ec-8b87-111778c54a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0310e062-143b-4e1c-9de7-e8fa23c1e66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:05 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Volume volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 (2e91d68b-8efa-4ac8-b919-fd5cda682e64): created successfully Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0310e062-143b-4e1c-9de7-e8fa23c1e66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (38fb3be1-30ab-4b64-9eea-325e92178061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:05 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-00170a80-866a-4cff-842b-18dc30e310e7 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:19:05 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.info" returned: 0 in 0.717s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-88179aea-a483-4c2c-9eb3-cd3ebe1bd7c4 tempest-VolumeDependencyTests-1892661892 None] Create snapshot completed successfully Apr 28 16:19:06 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.788s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Deleted volume successfully. Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c9232289-eb64-4691-b202-70455aa3d178 tempest-SnapshotDependencyTests-405802158 None] Lock "cinder-d97b8aee-5f09-4432-81e1-3dbcdaf8c42e-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (d6f0d89d-60e4-4c15-aae5-a0be07f8d65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c37a534-c071-4a54-bcb3-21ccd1733a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c37a534-c071-4a54-bcb3-21ccd1733a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979607648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1885b69a-59c3-4dfa-bc83-a64cdefc1dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d3a3bca-7c7f-4efe-b232-177c4d6ef77b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:07Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c6537-3090-4073-b1c3-584fff4d3046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c6537-3090-4073-b1c3-584fff4d3046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71156a9-0a8e-472f-883a-aaa5e45b8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71156a9-0a8e-472f-883a-aaa5e45b8d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1885b69a-59c3-4dfa-bc83-a64cdefc1dab', 'volume_name': 'volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab', 'volume_size': 1, 'snapshot_id': '9d3a3bca-7c7f-4efe-b232-177c4d6ef77b'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8227c71-f7e0-445f-a8a6-2ff389a60ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8227c71-f7e0-445f-a8a6-2ff389a60ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b6c1d-e477-4bd9-acfe-6fb81c4f37b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:06 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Volume 1885b69a-59c3-4dfa-bc83-a64cdefc1dab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab', 'volume_size': 1, 'snapshot_id': '9d3a3bca-7c7f-4efe-b232-177c4d6ef77b'} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Creating volume 1885b69a-59c3-4dfa-bc83-a64cdefc1dab from snapshot 9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] snapshot: 9d3a3bca-7c7f-4efe-b232-177c4d6ef77b, volume: 1885b69a-59c3-4dfa-bc83-a64cdefc1dab, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9272667-d36e-4efe-b7d2-8d9249f3af5e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:07 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:07 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (56d0c1fc-04a7-437a-8227-e378e0d94f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba9b933-35af-4977-bc66-78835172ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba9b933-35af-4977-bc66-78835172ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-651946536',display_name='tempest-VolumesGetTest-Volume-616950637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0c582a-782a-40c3-95c8-aa49e6745a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:08Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57652827-814c-4d91-b4d6-d73c19888f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57652827-814c-4d91-b4d6-d73c19888f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330d9a6e-2bd8-4177-9c5a-71ef2380f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330d9a6e-2bd8-4177-9c5a-71ef2380f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0c582a-782a-40c3-95c8-aa49e6745a72', 'volume_name': 'volume-2f0c582a-782a-40c3-95c8-aa49e6745a72', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d6e896-68b6-47a3-8aad-5ab71dde7d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d6e896-68b6-47a3-8aad-5ab71dde7d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9c5aca-071c-4d7b-86e4-0dae4f2f5f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:07 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Volume 2f0c582a-782a-40c3-95c8-aa49e6745a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0c582a-782a-40c3-95c8-aa49e6745a72', 'volume_size': 1} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:07 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.932s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d30357a5-2903-4d27-bdf7-eecc09093489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:19:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:19:08 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aae8f2-8140-4d93-8c2e-514decc218ea]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:08 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:08 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:08 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 0.757s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:08 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:19:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:08 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab Apr 28 16:19:08 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" returned: 0 in 6.108s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:14 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f7ce6-e755-494b-9b78-bafedfe20cd6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:15 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:15 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:15 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 1.059s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:15 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:19:15 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Converted 1024.00 MB image at 167.60 MB/s Apr 28 16:19:15 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab is being set with open permissions: ugo+rw Apr 28 16:19:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:15 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab Apr 28 16:19:15 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:16 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" returned: 0 in 0.676s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" released by "_copy_volume_from_snapshot" :: held 9.685s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" released by "_create_volume_from_snapshot" :: held 9.749s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.777s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.717s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-651946536',display_name='tempest-VolumesGetTest-Volume-616950637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0c582a-782a-40c3-95c8-aa49e6745a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406fadca9ce44f73b5b528f5baadc7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:08Z,use_quota=True,user_id='207afb9b36974203a14f8bf954bd84d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Creating volume 2f0c582a-782a-40c3-95c8-aa49e6745a72 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:19:16 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:16 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 1073741824 Apr 28 16:19:16 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b6c1d-e477-4bd9-acfe-6fb81c4f37b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab', 'volume_size': 1, 'snapshot_id': '9d3a3bca-7c7f-4efe-b232-177c4d6ef77b'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab055988-7227-41fe-bf60-d2f0195da3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:16 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Volume volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab (1885b69a-59c3-4dfa-bc83-a64cdefc1dab): created successfully Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab055988-7227-41fe-bf60-d2f0195da3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (d6f0d89d-60e4-4c15-aae5-a0be07f8d65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-08095092-7382-40d1-a920-2e57e6e822bb tempest-VolumeDependencyTests-1892661892 None] Created volume successfully. Apr 28 16:19:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Deleting offline snapshot 9d3a3bca-7c7f-4efe-b232-177c4d6ef77b of volume d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] snapshot_file for this snap is: volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3a163-2eab-415b-b6c7-5f3a6f033af3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:17 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:17 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:17 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 1073741824" returned: 0 in 1.021s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:17 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 Apr 28 16:19:17 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:17 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.811s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d30357a5-2903-4d27-bdf7-eecc09093489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[087dec06-542e-416d-9c57-0b0c97d29b80]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:18 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:18 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:18 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72" returned: 0 in 0.707s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9c5aca-071c-4d7b-86e4-0dae4f2f5f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0c582a-782a-40c3-95c8-aa49e6745a72', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22c3a58-9356-496a-88ee-820b8fe86b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:18 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Volume volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 (2f0c582a-782a-40c3-95c8-aa49e6745a72): created successfully Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22c3a58-9356-496a-88ee-820b8fe86b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Flow 'volume_create_manager' (56d0c1fc-04a7-437a-8227-e378e0d94f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a6bdfa28-c769-4968-9664-774406ab4e67 tempest-VolumesGetTest-252979578 None] Created volume successfully. Apr 28 16:19:18 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 0.850s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:18 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:18 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-2f0c582a-782a-40c3-95c8-aa49e6745a72-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "cinder-2f0c582a-782a-40c3-95c8-aa49e6745a72-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-2f0c582a-782a-40c3-95c8-aa49e6745a72" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-2f0c582a-782a-40c3-95c8-aa49e6745a72" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d85045-1965-4e66-84cb-c52ad72028e9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:19 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 Apr 28 16:19:19 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:19 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.759s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:19 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b Apr 28 16:19:19 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:20 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489.9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" returned: 0 in 0.612s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b" released by "_delete_snapshot" :: held 3.175s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" released by "delete_snapshot" :: held 3.218s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:20 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72" returned: 0 in 0.829s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:20 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72 Apr 28 16:19:20 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Created reservations ['b560e2a8-4363-4ff9-90c0-165534ae1412', 'c39f3352-bec5-4317-981d-1207f98ce998', 'e70db54d-c78a-4386-a14e-54a92e4f2fff', '95cb6050-e177-48ee-a35c-2d896ea44147'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:20 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Delete snapshot completed successfully. Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c99a5f5f-6bc6-4906-b7a7-ad2feac21f15 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-9d3a3bca-7c7f-4efe-b232-177c4d6ef77b-delete_snapshot" released by "delete_snapshot" :: held 3.377s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:20 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2f0c582a-782a-40c3-95c8-aa49e6745a72" returned: 0 in 0.634s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-2f0c582a-782a-40c3-95c8-aa49e6745a72" released by "delete_volume" :: held 1.503s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Created reservations ['ed596c0f-723e-4695-a83a-1ead5975f660', 'dd68689e-e4e7-4a8f-9f43-42eabd8d95c5', '3736d6be-4e56-4ce0-ab6a-94cedbc1c2f0', '480f656c-1ebe-4539-8a92-549101553444'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:21 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:21 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-d30357a5-2903-4d27-bdf7-eecc09093489-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-d30357a5-2903-4d27-bdf7-eecc09093489-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" acquired by "delete_volume" :: waited 0.042s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d500f5-ea16-4ec9-8664-093f0e30f2c3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:21 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:21 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-2e91d68b-8efa-4ac8-b919-fd5cda682e64-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "cinder-2e91d68b-8efa-4ac8-b919-fd5cda682e64-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:21 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.016s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:22 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Acquiring lock "cinder-quobyte-2e91d68b-8efa-4ac8-b919-fd5cda682e64" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-2e91d68b-8efa-4ac8-b919-fd5cda682e64" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-494251d4-06f9-427c-b97d-400fe0d2bc9b tempest-VolumesGetTest-252979578 None] Lock "cinder-2f0c582a-782a-40c3-95c8-aa49e6745a72-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db1dfe-2b2e-416a-8705-6cde189931f0]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:22 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:22 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:22 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 1.257s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:22 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489 Apr 28 16:19:22 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:23 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 0 in 0.934s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:23 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:23 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:23 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d30357a5-2903-4d27-bdf7-eecc09093489" returned: 0 in 0.704s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-d30357a5-2903-4d27-bdf7-eecc09093489" released by "delete_volume" :: held 2.122s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Created reservations ['10e76ac8-74b3-4a0f-b096-ce26e5cb3ae8', '5c1e626f-e08e-4684-8d0c-075773867f9e', 'b5a65740-4249-4e82-8f0f-55bb88a58f18', '35da01e6-398a-4b83-a021-0a405c6cadbc'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:23 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:23 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:24 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 1 in 0.919s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:24 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64 Apr 28 16:19:24 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:24 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.807s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Deleted volume successfully. Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f15b709-63ea-4ffa-9198-ae9ddabf8e10 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-d30357a5-2903-4d27-bdf7-eecc09093489-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:24 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-2e91d68b-8efa-4ac8-b919-fd5cda682e64" returned: 0 in 0.692s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "cinder-quobyte-2e91d68b-8efa-4ac8-b919-fd5cda682e64" released by "delete_volume" :: held 2.646s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Created reservations ['f8ecd0a1-e4e0-4097-8c23-79ebcb3483c6', 'b6006a3c-cd75-425b-b51e-1b1df3322964', '79d6bb5d-7d3c-485f-a151-a69256865eee', '54287c1b-72f5-4893-94dd-a9d75030aac0'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:24 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:24 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (a5641d54-d280-4432-a2d8-f3585abf2423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e3f313-850e-43eb-ac11-efc512d620dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e3f313-850e-43eb-ac11-efc512d620dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1041868398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f07c444-a29b-429e-9d95-002b9098e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:25Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d018c9d-53cd-43ed-ad5a-d8781eea63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d018c9d-53cd-43ed-ad5a-d8781eea63d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42677ba5-77d9-498a-8c46-c7d606068931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42677ba5-77d9-498a-8c46-c7d606068931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f07c444-a29b-429e-9d95-002b9098e28a', 'volume_name': 'volume-7f07c444-a29b-429e-9d95-002b9098e28a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35372e0c-1e9b-4327-9976-9b001cf1b2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35372e0c-1e9b-4327-9976-9b001cf1b2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b6979e-d287-4431-8f98-6cf42150e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Volume 7f07c444-a29b-429e-9d95-002b9098e28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f07c444-a29b-429e-9d95-002b9098e28a', 'volume_size': 1} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1041868398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f07c444-a29b-429e-9d95-002b9098e28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:25Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Creating volume 7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:19:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:25 devstack sudo[92205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a 1073741824 Apr 28 16:19:25 devstack sudo[92205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-edf59a04-da4f-4d4f-97b4-70f38b7e26a9 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" by "attach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-edf59a04-da4f-4d4f-97b4-70f38b7e26a9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" acquired by "attach_volume" :: waited 0.039s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-edf59a04-da4f-4d4f-97b4-70f38b7e26a9 tempest-VolumesActionsTest-1391775164 None] Attaching volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 to instance 2b9b87f3-cfb3-46e6-b9d4-1d7abc643b64 at mountpoint /dev/vdb on host None. Apr 28 16:19:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-edf59a04-da4f-4d4f-97b4-70f38b7e26a9 tempest-VolumesActionsTest-1391775164 None] Attach volume completed successfully. Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-edf59a04-da4f-4d4f-97b4-70f38b7e26a9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" released by "attach_volume" :: held 0.181s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:25 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.011s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Deleted volume successfully. Apr 28 16:19:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-1cafb223-4174-4051-805c-e51f66f0baae tempest-VolumesGetTest-252979578 None] Lock "cinder-2e91d68b-8efa-4ac8-b919-fd5cda682e64-delete_volume" released by "delete_volume" :: held 4.057s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:26 devstack sudo[92205]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-662fac37-7c92-4992-88ec-1eb90201dfcc tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" by "detach_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a 1073741824" returned: 0 in 1.145s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-662fac37-7c92-4992-88ec-1eb90201dfcc tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:26 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-662fac37-7c92-4992-88ec-1eb90201dfcc tempest-VolumesActionsTest-1391775164 None] Detaching volume 11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 from instance 2b9b87f3-cfb3-46e6-b9d4-1d7abc643b64. Apr 28 16:19:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:26 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:26 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:26 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-662fac37-7c92-4992-88ec-1eb90201dfcc tempest-VolumesActionsTest-1391775164 None] Detach volume completed successfully. Apr 28 16:19:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-662fac37-7c92-4992-88ec-1eb90201dfcc tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:27 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.821s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b6979e-d287-4431-8f98-6cf42150e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f07c444-a29b-429e-9d95-002b9098e28a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea6a91d-94ca-4817-b728-2a34e89aea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Volume volume-7f07c444-a29b-429e-9d95-002b9098e28a (7f07c444-a29b-429e-9d95-002b9098e28a): created successfully Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea6a91d-94ca-4817-b728-2a34e89aea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (a5641d54-d280-4432-a2d8-f3585abf2423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4f06122e-867c-45de-abae-46cd4b7cd069 tempest-VolumeDependencyTests-1892661892 None] Created volume successfully. Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (3562a0f1-8583-45ae-9f3e-f8e937cd77cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daee3122-7de5-4de5-82c3-27db49f7b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daee3122-7de5-4de5-82c3-27db49f7b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-148491046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f087e3d-fc26-4247-a35c-027bed4254c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc506dcb1349489bd71af34384f3a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7f07c444-a29b-429e-9d95-002b9098e28a,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:29Z,use_quota=True,user_id='3ca3c64969a24e6babc415b1d9f4e13c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8344547d-6ca7-40a4-a54f-a8d055cf9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8344547d-6ca7-40a4-a54f-a8d055cf9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dc2a3c-a5c7-4abc-82ae-c949585dfc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5dc2a3c-a5c7-4abc-82ae-c949585dfc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f087e3d-fc26-4247-a35c-027bed4254c5', 'volume_name': 'volume-4f087e3d-fc26-4247-a35c-027bed4254c5', 'volume_size': 1, 'source_volid': '7f07c444-a29b-429e-9d95-002b9098e28a', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1d41ac-a518-4b45-9287-f89953722ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1d41ac-a518-4b45-9287-f89953722ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c606fbe-34d1-44c9-86f1-0adec2c3eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:29 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Volume 4f087e3d-fc26-4247-a35c-027bed4254c5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f087e3d-fc26-4247-a35c-027bed4254c5', 'volume_size': 1, 'source_volid': '7f07c444-a29b-429e-9d95-002b9098e28a', 'source_volstatus': 'available'} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:29 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Cloning volume 7f07c444-a29b-429e-9d95-002b9098e28a to volume 4f087e3d-fc26-4247-a35c-027bed4254c5 Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Creating offline snapshot 012d6c9c-5bc7-4735-88a9-3524c66b507a of volume 7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccede762-add0-47c4-97b5-e3be00cb2de2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:29 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:29 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:30 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.836s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:30 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a 1G Apr 28 16:19:30 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:30 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a 1G" returned: 0 in 0.841s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f07c444-a29b-429e-9d95-002b9098e28a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:30 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f07c444-a29b-429e-9d95-002b9098e28a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:30 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:31 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f07c444-a29b-429e-9d95-002b9098e28a -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.673s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:31 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a is being set with open permissions: ugo+rw Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:31 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:31 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (0d2cb5ba-8c52-4c8f-878e-4789ae3acda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0ee243-a6d0-4058-a9ef-e82e01aef766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0ee243-a6d0-4058-a9ef-e82e01aef766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848693880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb6c46-60df-4721-ab1c-9ffea2f86594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:32Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67fbbe8-60a4-4909-aa6c-2ad016b91f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67fbbe8-60a4-4909-aa6c-2ad016b91f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2283e7-fa06-496e-b7f1-132f10d266c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2283e7-fa06-496e-b7f1-132f10d266c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84eb6c46-60df-4721-ab1c-9ffea2f86594', 'volume_name': 'volume-84eb6c46-60df-4721-ab1c-9ffea2f86594', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b304061-7ec3-47d3-a457-19ad1f7335f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b304061-7ec3-47d3-a457-19ad1f7335f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ca2d05-d54e-4e62-a062-5c7b6a4c3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:31 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Volume 84eb6c46-60df-4721-ab1c-9ffea2f86594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84eb6c46-60df-4721-ab1c-9ffea2f86594', 'volume_size': 1} Apr 28 16:19:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:32 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.608s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:32 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info Apr 28 16:19:32 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:32 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info" returned: 0 in 0.619s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:32 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info is being set with open permissions: ugo+rw Apr 28 16:19:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:32 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info Apr 28 16:19:32 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:33 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.info" returned: 0 in 0.611s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] snapshot: 012d6c9c-5bc7-4735-88a9-3524c66b507a, volume: 4f087e3d-fc26-4247-a35c-027bed4254c5, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[daae5a7f-00fb-4b2f-b8fe-652cf875ca9d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:33 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:33 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:34 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.752s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f07c444-a29b-429e-9d95-002b9098e28a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[986f5eb1-e01d-46bc-a1a3-5eba7731a79f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:34 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:34 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:34 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.717s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:19:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:35 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 Apr 28 16:19:35 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:39 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5" returned: 0 in 4.571s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff01acac-21df-4a1c-8ff2-b8c853623480]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:39 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:39 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:40 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.868s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:40 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:19:40 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Converted 1024.00 MB image at 223.98 MB/s Apr 28 16:19:40 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 is being set with open permissions: ugo+rw Apr 28 16:19:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:40 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 Apr 28 16:19:40 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:41 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5" returned: 0 in 0.605s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" released by "_copy_volume_from_snapshot" :: held 7.595s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-012d6c9c-5bc7-4735-88a9-3524c66b507a" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-012d6c9c-5bc7-4735-88a9-3524c66b507a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Deleting offline snapshot 012d6c9c-5bc7-4735-88a9-3524c66b507a of volume 7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] snapshot_file for this snap is: volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[050641f5-1ba4-4f7e-9527-070e8d3ce34d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:41 devstack sudo[92325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:41 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:41 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.698s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f07c444-a29b-429e-9d95-002b9098e28a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[526688ce-8281-4200-9ff0-440fe360b5b2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:41 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:41 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:42 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.678s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:42 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:42 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:43 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.667s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:43 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a Apr 28 16:19:43 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:43 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a.012d6c9c-5bc7-4735-88a9-3524c66b507a" returned: 0 in 0.586s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-012d6c9c-5bc7-4735-88a9-3524c66b507a" released by "_delete_snapshot" :: held 2.715s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.674s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.135s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848693880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84eb6c46-60df-4721-ab1c-9ffea2f86594,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:32Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Creating volume 84eb6c46-60df-4721-ab1c-9ffea2f86594 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:19:43 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c606fbe-34d1-44c9-86f1-0adec2c3eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f087e3d-fc26-4247-a35c-027bed4254c5', 'volume_size': 1, 'source_volid': '7f07c444-a29b-429e-9d95-002b9098e28a', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:43 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 1073741824 Apr 28 16:19:43 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d05834-c351-42c4-919c-50e8e944e88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:43 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Volume volume-4f087e3d-fc26-4247-a35c-027bed4254c5 (4f087e3d-fc26-4247-a35c-027bed4254c5): created successfully Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d05834-c351-42c4-919c-50e8e944e88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:43 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Flow 'volume_create_manager' (3562a0f1-8583-45ae-9f3e-f8e937cd77cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c026580d-6e1e-4348-9ded-b183f7dc3f47 tempest-VolumeDependencyTests-1892661892 None] Created volume successfully. Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-7f07c444-a29b-429e-9d95-002b9098e28a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-7f07c444-a29b-429e-9d95-002b9098e28a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-7f07c444-a29b-429e-9d95-002b9098e28a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-7f07c444-a29b-429e-9d95-002b9098e28a" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d06efeb-0771-4129-8ae7-866b19ac74fc]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:44 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:44 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:44 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 1073741824" returned: 0 in 0.771s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:44 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 Apr 28 16:19:44 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:44 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.725s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:44 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a Apr 28 16:19:44 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:45 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594" returned: 0 in 0.609s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 10.088s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ca2d05-d54e-4e62-a062-5c7b6a4c3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84eb6c46-60df-4721-ab1c-9ffea2f86594', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d386f0-8c79-49e1-b6b6-1a7e1813efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbef0f8-8f01-40d5-a0dd-c2b05a51f6ae]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:19:45 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Volume volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 (84eb6c46-60df-4721-ab1c-9ffea2f86594): created successfully Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d386f0-8c79-49e1-b6b6-1a7e1813efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (0d2cb5ba-8c52-4c8f-878e-4789ae3acda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-de5d781f-fbb5-4327-8107-8a0ac82737bd tempest-VolumesListTestJSON-54454658 None] Created volume successfully. Apr 28 16:19:45 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:19:45 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:45 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7f07c444-a29b-429e-9d95-002b9098e28a" returned: 0 in 0.591s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-7f07c444-a29b-429e-9d95-002b9098e28a" released by "delete_volume" :: held 1.374s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Created reservations ['d5d0b4d4-230d-4411-9fe7-7edba33641f7', 'e78d1fd8-531b-401e-8959-ab66c3894a1a', '52c6612a-bc7c-4d5f-9773-9382959edead', '8f1fe746-c70f-4a82-9454-0a62405988e1'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:45 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:45 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:46 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.754s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab5b54f-c813-4af6-bdaa-5cd97ef92645]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:46 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:19:46 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:46 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.608s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Deleted volume successfully. Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-86247358-ef68-43dc-b02c-a0169fb8669e tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-7f07c444-a29b-429e-9d95-002b9098e28a-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-4f087e3d-fc26-4247-a35c-027bed4254c5-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-4f087e3d-fc26-4247-a35c-027bed4254c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (62992e23-eafc-43f4-9865-d0cfe35b9958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cdb4ab-6199-49f4-8a98-2c757fb545fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cdb4ab-6199-49f4-8a98-2c757fb545fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350849549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5f9969-18c2-4752-acd0-42e0a47a4bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:46Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b069ce-0e70-4df2-9dbc-3b5550002f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b069ce-0e70-4df2-9dbc-3b5550002f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92190c6c-501a-4821-bf8b-101ceb1d5171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92190c6c-501a-4821-bf8b-101ceb1d5171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5f9969-18c2-4752-acd0-42e0a47a4bd9', 'volume_name': 'volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097b751-86a7-4bd5-afe2-f7e6afcfe5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0097b751-86a7-4bd5-afe2-f7e6afcfe5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc73053-5e9b-48a4-a558-185e04d6a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:46 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Volume ec5f9969-18c2-4752-acd0-42e0a47a4bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9', 'volume_size': 1} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fa806d-ef42-4e54-aadc-692ded496190]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:46 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 Apr 28 16:19:46 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:46 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.831s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.8e989031-8f05-483f-98ec-eca524f5ce54sfbusfch.img {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:46 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.8e989031-8f05-483f-98ec-eca524f5ce54sfbusfch.img Apr 28 16:19:46 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:47 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5" returned: 0 in 0.706s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:47 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5 Apr 28 16:19:47 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:48 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4f087e3d-fc26-4247-a35c-027bed4254c5" returned: 0 in 1.097s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-4f087e3d-fc26-4247-a35c-027bed4254c5" released by "delete_volume" :: held 1.875s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Created reservations ['642dc3f3-b564-453d-b0e5-25d44f002ac8', '910cb8d8-c198-434b-bd86-93d44e2a098e', '0ee54732-4f7a-4959-bac4-01e2e74558a8', '7d01406a-48f3-4b09-82f9-3c672603809b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:48 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:48 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:49 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.253s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:49 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Deleted volume successfully. Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-1885b69a-59c3-4dfa-bc83-a64cdefc1dab-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-8acfc695-1da5-4b77-bf0c-ed9d382f80b4 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-4f087e3d-fc26-4247-a35c-027bed4254c5-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-1885b69a-59c3-4dfa-bc83-a64cdefc1dab-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de67988-6ffe-4d4b-8664-83ad6e7afeb8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:50 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab Apr 28 16:19:50 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:51 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" returned: 0 in 1.340s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:51 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab Apr 28 16:19:51 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:51 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.8e989031-8f05-483f-98ec-eca524f5ce54sfbusfch.img" returned: 0 in 5.024s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9eb2ed-e5f1-4c49-bffc-f00b162f85cf]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:19:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:52 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:19:52 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:52 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-quobyte-1885b69a-59c3-4dfa-bc83-a64cdefc1dab" released by "delete_volume" :: held 2.139s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Created reservations ['da8c1942-8766-4e0e-9d3a-ea2479103bdd', 'af86ffc3-8823-4d69-b15e-7f790cc424ed', '25da3da8-e7b0-4f38-8309-23824ab06bbd', '05b06f5a-5a40-4c1c-94d1-6c84f21d7530'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:19:52 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:19:52 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:19:52 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.863s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.8e989031-8f05-483f-98ec-eca524f5ce54sfbusfch.img {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:19:52 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Converted 1024.00 MB image at 203.74 MB/s Apr 28 16:19:52 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] 8e989031-8f05-483f-98ec-eca524f5ce54 was raw, no need to convert to raw {{(pid=84171) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 28 16:19:53 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Apr 28 16:19:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.636s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:19:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:19:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Deleted volume successfully. Apr 28 16:19:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c348365e-64cd-4eb9-a897-607e80b73534 tempest-VolumeDependencyTests-1892661892 None] Lock "cinder-1885b69a-59c3-4dfa-bc83-a64cdefc1dab-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=86,cinder:UPDATE=117,cinder:INSERT=33,cinder:DELETE=10 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Flow 'volume_create_manager' (b479a71e-61d4-4b76-8454-9060d7860773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f22508-56c5-4dc3-9d3b-da9d5864c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f22508-56c5-4dc3-9d3b-da9d5864c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e4915-b384-4817-8862-b9e291545440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71271781eea64127a90f973a8f903013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:56Z,use_quota=True,user_id='767b4ba10d04416594a5258b861294c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c4bf30-4b0e-45f3-b7a6-0a9fc08f73e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c4bf30-4b0e-45f3-b7a6-0a9fc08f73e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f15bac3-a1a3-478b-8950-29d9e0bc2212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f15bac3-a1a3-478b-8950-29d9e0bc2212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477e4915-b384-4817-8862-b9e291545440', 'volume_name': 'volume-477e4915-b384-4817-8862-b9e291545440', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0bf126-3b48-48a3-aa38-0ac84106a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0bf126-3b48-48a3-aa38-0ac84106a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76757cc-8b3d-425d-8127-96f69be20afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:19:56 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Volume 477e4915-b384-4817-8862-b9e291545440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477e4915-b384-4817-8862-b9e291545440', 'volume_size': 1} Apr 28 16:19:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:00 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:00 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:01 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.656s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:06 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=24 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.014s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Uploaded volume to glance image-id: 8e989031-8f05-483f-98ec-eca524f5ce54. {{(pid=84171) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.795s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1350849549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5f9969-18c2-4752-acd0-42e0a47a4bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:46Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Creating volume ec5f9969-18c2-4752-acd0-42e0a47a4bd9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:12 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:12 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 1073741824 Apr 28 16:20:12 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:12 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-248379e5-2d46-4977-83c4-b693ad652305 tempest-VolumesActionsTest-1391775164 None] Copy volume to image completed successfully. Apr 28 16:20:13 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 1073741824" returned: 0 in 0.795s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:13 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 Apr 28 16:20:13 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:13 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" returned: 0 in 0.625s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.166s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e4915-b384-4817-8862-b9e291545440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71271781eea64127a90f973a8f903013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:19:56Z,use_quota=True,user_id='767b4ba10d04416594a5258b861294c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Creating volume 477e4915-b384-4817-8862-b9e291545440 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:13 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:13 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 1073741824 Apr 28 16:20:13 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc73053-5e9b-48a4-a558-185e04d6a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edab901-3597-4daf-aa39-17b95b38f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:13 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Volume volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 (ec5f9969-18c2-4752-acd0-42e0a47a4bd9): created successfully Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edab901-3597-4daf-aa39-17b95b38f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:13 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (62992e23-eafc-43f4-9865-d0cfe35b9958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:13 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-febfe70b-39b2-4d12-99e0-fdb23f03e70d tempest-VolumesListTestJSON-54454658 None] Created volume successfully. Apr 28 16:20:14 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 1073741824" returned: 0 in 0.790s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:14 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 Apr 28 16:20:14 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (b66fb82e-5a71-4aad-94c5-ed2df1876222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb839998-07c5-42e9-af12-1e7d1b7b6ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb839998-07c5-42e9-af12-1e7d1b7b6ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-963460677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:15Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839462c7-1d25-412e-b707-fcbc535d12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839462c7-1d25-412e-b707-fcbc535d12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0ec70d-294e-4063-bfe8-a723586603d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0ec70d-294e-4063-bfe8-a723586603d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9', 'volume_name': 'volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae41911c-ead5-4ffd-af84-8dc291eeeb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae41911c-ead5-4ffd-af84-8dc291eeeb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c96cd7b-3a11-4d2b-be6e-f45138a71192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Volume 8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9', 'volume_size': 1} Apr 28 16:20:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:15 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440" returned: 0 in 0.575s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.666s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76757cc-8b3d-425d-8127-96f69be20afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477e4915-b384-4817-8862-b9e291545440', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a57e56-d588-40d9-8fb1-0e396a7567fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6743e-2897-47fd-b44a-16ad2d373644]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Volume volume-477e4915-b384-4817-8862-b9e291545440 (477e4915-b384-4817-8862-b9e291545440): created successfully Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a57e56-d588-40d9-8fb1-0e396a7567fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Flow 'volume_create_manager' (b479a71e-61d4-4b76-8454-9060d7860773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4c5bb025-26d0-45d4-941e-0f3b2d74ae83 tempest-CinderUnicodeTest-630201619 None] Created volume successfully. Apr 28 16:20:15 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:20:15 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:15 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.778s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5bc771-66c7-423e-bbc0-b4478f368290]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:16 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:20:16 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Flow 'volume_create_manager' (f8e29b2c-6fae-40bc-a56a-0d49cc159f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01acfb76-5459-4980-aaae-392af9ec5e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01acfb76-5459-4980-aaae-392af9ec5e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1702268956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28776d86-f6d8-4924-8e95-1b27aada8bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71271781eea64127a90f973a8f903013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:16Z,use_quota=True,user_id='767b4ba10d04416594a5258b861294c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4e9201-6ad7-45e6-b3d6-16f19b2d336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4e9201-6ad7-45e6-b3d6-16f19b2d336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d549e3-725a-411c-860a-5feef230f23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:16 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d549e3-725a-411c-860a-5feef230f23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28776d86-f6d8-4924-8e95-1b27aada8bb9', 'volume_name': 'volume-28776d86-f6d8-4924-8e95-1b27aada8bb9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f3f329-2de5-4d03-9ae7-4dcfdfeea085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f3f329-2de5-4d03-9ae7-4dcfdfeea085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55bdfdb-8701-42be-94ed-07db0a215e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:16 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Volume 28776d86-f6d8-4924-8e95-1b27aada8bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28776d86-f6d8-4924-8e95-1b27aada8bb9', 'volume_size': 1} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.773s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:16 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img Apr 28 16:20:16 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:21 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img" returned: 0 in 4.341s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26d2f4a-f32a-4846-8706-f4cb309deccc]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:21 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:20:21 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:21 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.852s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:20:21 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Converted 1024.00 MB image at 235.84 MB/s Apr 28 16:20:21 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] fbe5827c-21c5-4072-828a-5cce395ad7ca was raw, converting to qcow2 {{(pid=84171) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 28 16:20:22 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ad8b26-5dfa-41dc-ac2e-5304c6e966ff]: (4, 'raw') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:22 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img Apr 28 16:20:22 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:22 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img" returned: 0 in 0.683s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:22 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img Apr 28 16:20:22 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:23 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img" returned: 1 in 0.674s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img' failed. Not Retrying. {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:23 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h Apr 28 16:20:23 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:23 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h" returned: 0 in 0.597s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Image conversion details: src /opt/stack/data/cinder/conversion/11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6.temp_image.fbe5827c-21c5-4072-828a-5cce395ad7caypn11rrr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:20:23 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c9c565-d207-48f7-9c6a-9b8b75984767]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:24 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h Apr 28 16:20:24 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:24 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_z64d0q6h" returned: 0 in 0.647s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.619s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Uploaded volume to glance image-id: fbe5827c-21c5-4072-828a-5cce395ad7ca. {{(pid=84171) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.027s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-963460677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='584c042ce880488b81aba0b4f03a7b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:15Z,use_quota=True,user_id='3dcaca6a9ffa4bfebc52d46c5aeffec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Creating volume 8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:25 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:25 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 1073741824 Apr 28 16:20:25 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b8fc4866-1f39-4d3a-b376-36e19bbe5829 tempest-VolumesActionsTest-1391775164 None] Copy volume to image completed successfully. Apr 28 16:20:26 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 1073741824" returned: 0 in 0.791s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:26 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 Apr 28 16:20:26 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "cinder-quobyte-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-quobyte-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075cb34-4541-417a-8130-057775eb3127]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:26 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:20:26 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:27 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" returned: 0 in 0.585s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.462s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1702268956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28776d86-f6d8-4924-8e95-1b27aada8bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71271781eea64127a90f973a8f903013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:16Z,use_quota=True,user_id='767b4ba10d04416594a5258b861294c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Creating volume 28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:27 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c96cd7b-3a11-4d2b-be6e-f45138a71192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:27 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 1073741824 Apr 28 16:20:27 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e565f77f-ac51-4ef8-8a56-22715562a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:27 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Volume volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 (8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9): created successfully Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e565f77f-ac51-4ef8-8a56-22715562a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Flow 'volume_create_manager' (b66fb82e-5a71-4aad-94c5-ed2df1876222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-219e8e61-964b-417e-a497-04233732895e tempest-VolumesListTestJSON-54454658 None] Created volume successfully. Apr 28 16:20:27 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.728s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:27 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6 Apr 28 16:20:27 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:28 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 1073741824" returned: 0 in 0.814s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:28 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 Apr 28 16:20:28 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" returned: 0 in 0.634s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-quobyte-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6" released by "delete_volume" :: held 1.416s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Created reservations ['d47d07d7-7bf0-4a58-b12f-920269c57f24', '61493781-f8b8-4982-a782-ab4aa5d2bd32', '9b40f2bd-2576-4292-bc3a-482de1baf646', '700bbb8f-e459-45d0-9719-70f2ce8428eb'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:28 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:28 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:28 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9" returned: 0 in 0.650s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55bdfdb-8701-42be-94ed-07db0a215e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28776d86-f6d8-4924-8e95-1b27aada8bb9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d77b967-e548-4af9-ad99-2f3013cbfd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:28 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Volume volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 (28776d86-f6d8-4924-8e95-1b27aada8bb9): created successfully Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d77b967-e548-4af9-ad99-2f3013cbfd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Flow 'volume_create_manager' (f8e29b2c-6fae-40bc-a56a-0d49cc159f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:28 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8c4ffbef-8001-4558-9da7-e97125575a09 tempest-CinderUnicodeTest-630201619 None] Created volume successfully. Apr 28 16:20:28 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.616s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:28 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Deleted volume successfully. Apr 28 16:20:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-72ce27af-f86f-4338-8908-f94cd6c856b9 tempest-VolumesActionsTest-1391775164 None] Lock "cinder-11fec9f7-2f6b-48b8-823b-40a2b1c3a9f6-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Creating offline snapshot 3ca8b432-5d85-4094-8bea-9af06f056c69 of volume 28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:20:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e3270-cf97-4983-b000-96c3c67e3c20]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:29 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 Apr 28 16:20:29 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:30 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9" returned: 0 in 0.825s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:30 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 1G Apr 28 16:20:30 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-quobyte-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7a352d-b9e2-40a8-9e9a-ca661ba4547f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:30 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 Apr 28 16:20:30 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:31 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 1G" returned: 0 in 0.840s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:31 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" returned: 0 in 0.786s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:31 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 Apr 28 16:20:31 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:31 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9 Apr 28 16:20:31 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:31 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" returned: 0 in 0.666s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:31 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69" returned: 0 in 0.709s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:31 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 is being set with open permissions: ugo+rw Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9" released by "delete_volume" :: held 1.514s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:31 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 Apr 28 16:20:31 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Created reservations ['7a47cc43-4135-4cbb-a613-2de4ba8539d5', '20b7b645-d02e-43c9-b0af-2f52984039d7', 'a4d2fc01-8b56-436c-a013-f6f0b42e3b7f', 'bccbc0bf-24bc-41a1-829f-d75d9c603505'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:31 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:31 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:32 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-ec5f9969-18c2-4752-acd0-42e0a47a4bd9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69" returned: 0 in 0.735s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-ec5f9969-18c2-4752-acd0-42e0a47a4bd9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-quobyte-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:32 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info Apr 28 16:20:32 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" acquired by "delete_volume" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5237b742-9872-487e-abb6-1c3c9cc9b04b]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:32 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.697s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:32 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Deleted volume successfully. Apr 28 16:20:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e0ba160-a91c-4037-a7f9-9e0236c604f2 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-8dfb960d-779c-4fbf-8f12-fdb8ba4d3bd9-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:32 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 Apr 28 16:20:32 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:33 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info is being set with open permissions: ugo+rw Apr 28 16:20:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:33 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info Apr 28 16:20:33 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:33 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" returned: 0 in 0.940s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:33 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9 Apr 28 16:20:33 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:34 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.info" returned: 0 in 0.667s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.766s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-776c0cca-7d34-47ba-a629-f778d0b06579 tempest-CinderUnicodeTest-630201619 None] Create snapshot completed successfully Apr 28 16:20:34 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" returned: 0 in 0.686s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-ec5f9969-18c2-4752-acd0-42e0a47a4bd9" released by "delete_volume" :: held 1.671s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Created reservations ['882b5478-3780-4a99-bbb6-2c4b6ad06795', '2784e3f9-01e4-465e-b48d-a89de33544aa', '9c12e239-b615-4fb6-9c40-df5a87086140', '52f3f4f1-a23c-47d7-a73a-e2a55a1aa803'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:34 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:34 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-3ca8b432-5d85-4094-8bea-9af06f056c69-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-3ca8b432-5d85-4094-8bea-9af06f056c69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-quobyte-3ca8b432-5d85-4094-8bea-9af06f056c69" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-3ca8b432-5d85-4094-8bea-9af06f056c69" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Deleting offline snapshot 3ca8b432-5d85-4094-8bea-9af06f056c69 of volume 28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] snapshot_file for this snap is: volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdfdf30-8d0c-4146-8ece-6c2503073431]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-84eb6c46-60df-4721-ab1c-9ffea2f86594-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "cinder-84eb6c46-60df-4721-ab1c-9ffea2f86594-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:34 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 Apr 28 16:20:34 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Acquiring lock "cinder-quobyte-84eb6c46-60df-4721-ab1c-9ffea2f86594" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-84eb6c46-60df-4721-ab1c-9ffea2f86594" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd430fbb-ef28-44f0-87d2-5608c7e57e1d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:35 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:35 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.749s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:35 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Deleted volume successfully. Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-76715305-4fb8-4988-87f5-3a5d7263aad6 tempest-VolumesListTestJSON-54454658 None] Lock "cinder-ec5f9969-18c2-4752-acd0-42e0a47a4bd9-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Flow 'volume_create_manager' (1ce721db-f30f-4d7c-aee9-c270e6a87ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7327ae38-d68c-4a99-bbdb-727d4f942160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7327ae38-d68c-4a99-bbdb-727d4f942160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1687889622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c1c3fb-9454-4689-8440-5c0ad3b079ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028d0714b6b04e2692b802f1cad8b75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:35Z,use_quota=True,user_id='1811352ab0e7428ea107c8e8f4472e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf1a00e-f6c5-4f3a-8d22-11e60ab68703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf1a00e-f6c5-4f3a-8d22-11e60ab68703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a86521-35ff-41dc-8905-06405fc36f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a86521-35ff-41dc-8905-06405fc36f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c1c3fb-9454-4689-8440-5c0ad3b079ce', 'volume_name': 'volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2769f1-0a4f-4005-86ce-971e4249a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2769f1-0a4f-4005-86ce-971e4249a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446803e-1def-416a-b5fb-2ce927ad0848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Volume 73c1c3fb-9454-4689-8440-5c0ad3b079ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce', 'volume_size': 1} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1687889622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c1c3fb-9454-4689-8440-5c0ad3b079ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028d0714b6b04e2692b802f1cad8b75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:35Z,use_quota=True,user_id='1811352ab0e7428ea107c8e8f4472e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Creating volume 73c1c3fb-9454-4689-8440-5c0ad3b079ce {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:35 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:35 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce 1073741824 Apr 28 16:20:35 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:35 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69" returned: 0 in 0.905s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28776d86-f6d8-4924-8e95-1b27aada8bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068c05c-250d-407b-ba95-fed44fb2d2df]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:35 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 Apr 28 16:20:35 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:35 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:35 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594 Apr 28 16:20:35 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:36 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce 1073741824" returned: 0 in 0.814s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:36 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce Apr 28 16:20:36 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:36 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:36 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9" returned: 0 in 0.791s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-84eb6c46-60df-4721-ab1c-9ffea2f86594" returned: 0 in 0.644s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:36 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 Apr 28 16:20:36 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "cinder-quobyte-84eb6c46-60df-4721-ab1c-9ffea2f86594" released by "delete_volume" :: held 1.522s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Created reservations ['e26baf6e-6bb1-4615-8457-e9a28aff9d0d', 'b2a0ccad-6148-4add-9476-c1b8e5b44d8c', '5342b479-356d-4f4a-9b5c-ea9496c9b4fe', 'e359ec54-99ff-487c-a1c7-5f4f0e498c89'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:36 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:36 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:36 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce" returned: 0 in 0.644s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0446803e-1def-416a-b5fb-2ce927ad0848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31640b31-03e8-4b27-b730-80344b977777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Volume volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce (73c1c3fb-9454-4689-8440-5c0ad3b079ce): created successfully Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31640b31-03e8-4b27-b730-80344b977777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Flow 'volume_create_manager' (1ce721db-f30f-4d7c-aee9-c270e6a87ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-60471dbd-7395-4766-954a-75c8b06172bf tempest-VolumesNegativeTest-708116146 None] Created volume successfully. Apr 28 16:20:37 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:37 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69 Apr 28 16:20:37 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:37 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.673s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:37 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Deleted volume successfully. Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-23130021-3c4c-4b70-b422-a99d2031209c tempest-VolumesListTestJSON-54454658 None] Lock "cinder-84eb6c46-60df-4721-ab1c-9ffea2f86594-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:37 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9.3ca8b432-5d85-4094-8bea-9af06f056c69" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-3ca8b432-5d85-4094-8bea-9af06f056c69" released by "_delete_snapshot" :: held 3.226s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" released by "delete_snapshot" :: held 3.256s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:37 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Created reservations ['2da640f2-6c3b-4082-a359-2f8c92b57639', '26bc4469-f8e9-4c7d-a6e1-63380ca49681', 'b20a7533-5cbf-4834-87a7-061d40de6e14', '447ee78e-dc55-4974-9b3b-9131f692682b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Delete snapshot completed successfully. Apr 28 16:20:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b6ae9542-4b82-4525-8383-a8e4c02a73b3 tempest-CinderUnicodeTest-630201619 None] Lock "cinder-3ca8b432-5d85-4094-8bea-9af06f056c69-delete_snapshot" released by "delete_snapshot" :: held 3.424s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-28776d86-f6d8-4924-8e95-1b27aada8bb9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "cinder-28776d86-f6d8-4924-8e95-1b27aada8bb9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b8e27-da0d-4696-ac6b-97b0e1aabbc8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:39 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 Apr 28 16:20:39 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:39 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9" returned: 0 in 0.763s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:39 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9 Apr 28 16:20:39 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Flow 'volume_create_manager' (9f2de9fa-9e58-4ef7-b8c1-a480acfd4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a865ff1c-d40a-46e8-9ba5-582f59576739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a865ff1c-d40a-46e8-9ba5-582f59576739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1004218268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34054e7-e79e-41d1-816b-5a73e457d9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ba866a1d2b424087e49153a1d0bf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:40Z,use_quota=True,user_id='2f70373864e44853a65ce36d898aa3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e929253-2b36-4b0d-8d90-56897c5df1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e929253-2b36-4b0d-8d90-56897c5df1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32aeadd8-b55d-4b22-9fb6-47c3d41d739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32aeadd8-b55d-4b22-9fb6-47c3d41d739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34054e7-e79e-41d1-816b-5a73e457d9f8', 'volume_name': 'volume-a34054e7-e79e-41d1-816b-5a73e457d9f8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a48345-802a-4b62-9620-d6d0851322ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a48345-802a-4b62-9620-d6d0851322ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d4451a-1590-4074-8f99-6d433be40788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Volume a34054e7-e79e-41d1-816b-5a73e457d9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34054e7-e79e-41d1-816b-5a73e457d9f8', 'volume_size': 1} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1004218268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34054e7-e79e-41d1-816b-5a73e457d9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ba866a1d2b424087e49153a1d0bf52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:20:40Z,use_quota=True,user_id='2f70373864e44853a65ce36d898aa3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Creating volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:20:40 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:40 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 1073741824 Apr 28 16:20:40 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:40 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-28776d86-f6d8-4924-8e95-1b27aada8bb9" returned: 0 in 0.625s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-28776d86-f6d8-4924-8e95-1b27aada8bb9" released by "delete_volume" :: held 1.469s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Created reservations ['6a80ab97-ddc9-4c79-8ee7-62fe348a098d', '9f4bb86e-998e-4670-9d2c-6273e72cbb51', '5c9bb0d9-d3de-4a56-b38b-96c7eb7d38c2', '58f3f840-1a85-4c78-8136-e67c4dcbfa8e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:40 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:40 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:40 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 1073741824" returned: 0 in 0.828s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:41 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 Apr 28 16:20:41 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-477e4915-b384-4817-8862-b9e291545440-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "cinder-477e4915-b384-4817-8862-b9e291545440-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Acquiring lock "cinder-quobyte-477e4915-b384-4817-8862-b9e291545440" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:41 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.659s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-477e4915-b384-4817-8862-b9e291545440" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Deleted volume successfully. Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6034dd95-8762-47d8-a6fc-bb1719e3cb3e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-473b8946-1b48-4e3a-8637-53ef6e13390c tempest-CinderUnicodeTest-630201619 None] Lock "cinder-28776d86-f6d8-4924-8e95-1b27aada8bb9-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:41 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 Apr 28 16:20:41 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:41 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8" returned: 0 in 0.623s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d4451a-1590-4074-8f99-6d433be40788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34054e7-e79e-41d1-816b-5a73e457d9f8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1143ab7e-e786-4b34-83af-e29a1c97cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:20:41 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Volume volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 (a34054e7-e79e-41d1-816b-5a73e457d9f8): created successfully Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1143ab7e-e786-4b34-83af-e29a1c97cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:20:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Flow 'volume_create_manager' (9f2de9fa-9e58-4ef7-b8c1-a480acfd4662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:20:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8c27f127-4971-40fd-a112-119b81cd609f tempest-VolumesSnapshotListTestJSON-812036384 None] Created volume successfully. Apr 28 16:20:42 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440" returned: 0 in 0.759s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:42 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440 Apr 28 16:20:42 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Creating offline snapshot ba0c5b79-d8fa-4f32-8b22-8b57e61801ba of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72f4e7-4894-4a44-b579-36743dd825b6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:42 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 Apr 28 16:20:42 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:42 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-477e4915-b384-4817-8862-b9e291545440" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "cinder-quobyte-477e4915-b384-4817-8862-b9e291545440" released by "delete_volume" :: held 1.430s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Created reservations ['d780617f-a29a-4d6e-8371-786b295fc879', 'f10b93b3-6598-4c0e-a6f9-83fd52675868', '98b6ffa9-9cc5-449b-b4e6-9bdd10f26097', '68c9246a-e68d-4915-a98b-d8cee64970c0'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:42 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:20:42 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:43 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:43 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba 1G Apr 28 16:20:43 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:43 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.686s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:43 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:20:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Deleted volume successfully. Apr 28 16:20:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4ad8da76-09e3-475d-8e9e-68922df0196e tempest-CinderUnicodeTest-630201619 None] Lock "cinder-477e4915-b384-4817-8862-b9e291545440-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:44 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba 1G" returned: 0 in 0.933s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:44 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:20:44 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:44 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.860s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:44 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba is being set with open permissions: ugo+rw Apr 28 16:20:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:45 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:20:45 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:45 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.772s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:45 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info Apr 28 16:20:45 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:46 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info" returned: 0 in 0.604s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:46 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info is being set with open permissions: ugo+rw Apr 28 16:20:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:46 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info Apr 28 16:20:46 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:46 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.info" returned: 0 in 0.586s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:47 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a0c94591-932d-4823-aa89-ff3404785288 tempest-VolumesSnapshotListTestJSON-812036384 None] Create snapshot completed successfully Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Creating offline snapshot 6105dd06-5186-4987-ac44-4c6726ee1675 of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8ac64-b077-4b8a-a064-310cfbe45d77]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:47 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:20:47 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:48 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.745s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:20:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:48 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 1G Apr 28 16:20:48 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:49 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 1G" returned: 0 in 0.799s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:49 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:20:49 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:50 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.652s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:50 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 is being set with open permissions: ugo+rw Apr 28 16:20:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:50 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:20:50 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:50 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.594s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:50 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d7ea5a77-70bf-4afa-bb1e-e06736837f9f tempest-VolumesSnapshotListTestJSON-812036384 None] Create snapshot completed successfully Apr 28 16:20:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:20:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:20:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Creating offline snapshot 1084b658-2a62-4f6f-a527-c5b656d64d70 of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:20:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38854ad-ef88-4235-bffb-e9892cae71c0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:51 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:20:51 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:52 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.936s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:20:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:52 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 1G Apr 28 16:20:52 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:53 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 1G" returned: 0 in 0.842s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:53 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 Apr 28 16:20:53 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:54 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70" returned: 0 in 0.836s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:54 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 is being set with open permissions: ugo+rw Apr 28 16:20:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:54 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 Apr 28 16:20:54 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:54 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70" returned: 0 in 0.639s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:20:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-6e7245bc-1c45-44e5-847f-98ede5a5372f tempest-VolumesSnapshotListTestJSON-812036384 None] Create snapshot completed successfully Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-1084b658-2a62-4f6f-a527-c5b656d64d70-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-1084b658-2a62-4f6f-a527-c5b656d64d70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-1084b658-2a62-4f6f-a527-c5b656d64d70" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-1084b658-2a62-4f6f-a527-c5b656d64d70" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Deleting offline snapshot 1084b658-2a62-4f6f-a527-c5b656d64d70 of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] snapshot_file for this snap is: volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d07719-d579-4695-ab52-c8e76ca59eb1]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:56 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 Apr 28 16:20:56 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:57 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70" returned: 0 in 0.765s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c2376-2859-4e5a-a341-523b166186b9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:57 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:20:57 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:57 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.737s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:20:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:57 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 Apr 28 16:20:57 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:58 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70" returned: 0 in 0.749s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:58 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70 Apr 28 16:20:58 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:20:59 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.1084b658-2a62-4f6f-a527-c5b656d64d70" returned: 0 in 0.598s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-1084b658-2a62-4f6f-a527-c5b656d64d70" released by "_delete_snapshot" :: held 2.942s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" released by "delete_snapshot" :: held 2.964s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Created reservations ['247e5af5-53f9-4ed7-bf18-4f5b7d221577', 'a366aa10-ac4f-4c5e-ade1-72714827ad53', '29b922b4-e057-4999-84b1-01b2f57aa6f4', '5563bf5f-a552-4e59-9d0a-ee5b857d553d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:20:59 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Delete snapshot completed successfully. Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-36d1bb9b-4fbf-483c-9d1f-b6b0109af93f tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-1084b658-2a62-4f6f-a527-c5b656d64d70-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-6105dd06-5186-4987-ac44-4c6726ee1675-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-6105dd06-5186-4987-ac44-4c6726ee1675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-6105dd06-5186-4987-ac44-4c6726ee1675" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-6105dd06-5186-4987-ac44-4c6726ee1675" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Deleting offline snapshot 6105dd06-5186-4987-ac44-4c6726ee1675 of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] snapshot_file for this snap is: volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0066f-2915-4726-9688-ce319ae5a74e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:20:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:20:59 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:20:59 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:00 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a14542-284f-4a9b-86ed-60e4a66fae90]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:00 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:21:00 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:00 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:00 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:00 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.719s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:21:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:00 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:21:00 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:01 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.648s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:01 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.751s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:01 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675 Apr 28 16:21:01 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:02 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.6105dd06-5186-4987-ac44-4c6726ee1675" returned: 0 in 0.612s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-6105dd06-5186-4987-ac44-4c6726ee1675" released by "_delete_snapshot" :: held 2.902s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" released by "delete_snapshot" :: held 2.924s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Created reservations ['890a4ac1-f66f-40da-bba7-862912245c8d', '899dc2ef-ced2-4d18-b939-0b842a2b4278', '961ba8eb-11ec-4b54-93c5-69d27c0aa462', 'd73ed37c-8858-4b6f-a46e-1b07a0cc3655'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:02 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Delete snapshot completed successfully. Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-3247a9ef-56a7-4614-9bab-f34454d11769 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-6105dd06-5186-4987-ac44-4c6726ee1675-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Deleting offline snapshot ba0c5b79-d8fa-4f32-8b22-8b57e61801ba of volume a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] snapshot_file for this snap is: volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f34f1-3c8d-464a-8a48-594d16fd8f70]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:02 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:21:02 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:03 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.733s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34054e7-e79e-41d1-816b-5a73e457d9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:21:03 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f3ded-f153-4ce1-8b69-295ba29bf7e6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:03 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 Apr 28 16:21:03 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:04 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8" returned: 0 in 0.725s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:04 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:21:04 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:04 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.717s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:04 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba Apr 28 16:21:04 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:05 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8.ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" returned: 0 in 0.638s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba" released by "_delete_snapshot" :: held 2.934s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" released by "delete_snapshot" :: held 2.959s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Created reservations ['537010a7-dc21-4914-92a7-c82bb1a07f0c', 'a7fa15ac-4624-4433-a19e-d237b5bbe4ed', '862fbe7a-8483-4053-8bb8-8271b5469def', '4e75652b-181d-4ae1-8b64-ee74fae1e62d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:05 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Delete snapshot completed successfully. Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b9d9d3c4-f887-4b91-8f82-5433969c7bac tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-ba0c5b79-d8fa-4f32-8b22-8b57e61801ba-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-a34054e7-e79e-41d1-816b-5a73e457d9f8-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-a34054e7-e79e-41d1-816b-5a73e457d9f8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16df295-9c4b-48c4-8b73-f131d3c1d64e]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:06 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 Apr 28 16:21:06 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:06 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:06 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8 Apr 28 16:21:06 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Acquiring lock "cinder-73c1c3fb-9454-4689-8440-5c0ad3b079ce-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "cinder-73c1c3fb-9454-4689-8440-5c0ad3b079ce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=90,cinder:SELECT=74,cinder:INSERT=24,cinder:DELETE=7 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=79,cinder:UPDATE=99,cinder:INSERT=24,cinder:DELETE=9 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Acquiring lock "cinder-quobyte-73c1c3fb-9454-4689-8440-5c0ad3b079ce" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "cinder-quobyte-73c1c3fb-9454-4689-8440-5c0ad3b079ce" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:07 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a34054e7-e79e-41d1-816b-5a73e457d9f8" returned: 0 in 0.639s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e90fa6-5283-4433-94d7-628e07f19134]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-quobyte-a34054e7-e79e-41d1-816b-5a73e457d9f8" released by "delete_volume" :: held 1.458s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Created reservations ['bcb0ca2a-e49e-447a-b6f4-310dadfb7c12', '2d0aaf9a-cb02-4467-b3f5-393894502d33', 'b069eb71-004e-47c0-b1e2-5cdcc09c6110', 'd53f4bc4-0f2f-4430-8e81-4913f34b9027'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:07 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce Apr 28 16:21:07 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:07 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:07 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:08 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce" returned: 0 in 0.809s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:08 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:08 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce Apr 28 16:21:08 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.655s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:08 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Deleted volume successfully. Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a83608e5-1b20-46dc-afc5-0f6b4bbdce63 tempest-VolumesSnapshotListTestJSON-812036384 None] Lock "cinder-a34054e7-e79e-41d1-816b-5a73e457d9f8-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:08 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-73c1c3fb-9454-4689-8440-5c0ad3b079ce" returned: 0 in 0.677s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "cinder-quobyte-73c1c3fb-9454-4689-8440-5c0ad3b079ce" released by "delete_volume" :: held 1.588s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:08 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Created reservations ['7f1665a6-d06a-407d-96fc-6a5f45f86c7f', '1b7d783e-0ee1-442b-aedd-c644e19643ee', '720adbea-48e5-4ab9-9036-637a92385f0a', 'e844b30f-b7bf-45b9-ac0c-c7a01a9bf830'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:09 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:09 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:09 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.662s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:09 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Deleted volume successfully. Apr 28 16:21:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4b865cf4-e208-4538-a4de-6f5f2238ece9 tempest-VolumesNegativeTest-708116146 None] Lock "cinder-73c1c3fb-9454-4689-8440-5c0ad3b079ce-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (153617c1-509f-40ec-a38b-f0bb7f92863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa96cc6a-6747-41b6-bb27-5632f6bb0c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa96cc6a-6747-41b6-bb27-5632f6bb0c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005502561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f629a-0ee3-4a81-adb2-d183767f1fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:11Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d95575-4344-4aa6-8505-014a5bf00d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d95575-4344-4aa6-8505-014a5bf00d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff56a994-4214-4518-a5b0-005d68e6f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff56a994-4214-4518-a5b0-005d68e6f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491f629a-0ee3-4a81-adb2-d183767f1fca', 'volume_name': 'volume-491f629a-0ee3-4a81-adb2-d183767f1fca', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6150671d-ce17-4b6d-9f28-09cd509b5d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6150671d-ce17-4b6d-9f28-09cd509b5d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2211f99d-545a-41d8-9f14-048b209c3a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Volume 491f629a-0ee3-4a81-adb2-d183767f1fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491f629a-0ee3-4a81-adb2-d183767f1fca', 'volume_size': 1} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005502561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f629a-0ee3-4a81-adb2-d183767f1fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:11Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Creating volume 491f629a-0ee3-4a81-adb2-d183767f1fca {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:11 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:11 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca 1073741824 Apr 28 16:21:11 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (15f5eeea-9306-406d-aaa8-d4cd43be65fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098f2491-639c-4b6b-a3ca-c0de6ffcfa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098f2491-639c-4b6b-a3ca-c0de6ffcfa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897977139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a4cc42-4333-4f4d-b815-d512e81c96ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:11Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc29d7d6-ccab-4eb0-82ff-7f9cca54f86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc29d7d6-ccab-4eb0-82ff-7f9cca54f86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00ffe14-f5c7-4d8d-8b22-551ed1ef2f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00ffe14-f5c7-4d8d-8b22-551ed1ef2f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a4cc42-4333-4f4d-b815-d512e81c96ef', 'volume_name': 'volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c7491-4ab3-4271-b197-34259ae54a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c7491-4ab3-4271-b197-34259ae54a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598bc06c-9bf8-4604-9b11-8890473e6ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Volume f5a4cc42-4333-4f4d-b815-d512e81c96ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef', 'volume_size': 1} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (717be906-0d91-4d76-b785-253440805ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e611227f-9f92-4ee6-a530-4594c0b4ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e611227f-9f92-4ee6-a530-4594c0b4ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1110174191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2b8e38-3c12-414d-b250-2966bc049611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2b8e38-3c12-414d-b250-2966bc049611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa46d64-c36d-4aa9-8e49-6999aebc5189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa46d64-c36d-4aa9-8e49-6999aebc5189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1', 'volume_name': 'volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffea41a3-4394-407d-b716-a2bd03b9289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffea41a3-4394-407d-b716-a2bd03b9289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1afd0c-3974-40c6-9fa8-1892500e17c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:11 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Volume 36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1', 'volume_size': 1} Apr 28 16:21:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:12 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca 1073741824" returned: 0 in 0.915s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (b8eee245-a90b-4f44-b252-db02873384a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c14b97b-098d-4c68-a67b-eca2c403192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c14b97b-098d-4c68-a67b-eca2c403192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-689562645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76526903-945b-4c71-8706-e2b8278277a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6731165-b8dc-4af6-a0d7-89d6dac812e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6731165-b8dc-4af6-a0d7-89d6dac812e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca Apr 28 16:21:12 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78e856c-9998-485d-b857-1f8a21a052f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78e856c-9998-485d-b857-1f8a21a052f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76526903-945b-4c71-8706-e2b8278277a2', 'volume_name': 'volume-76526903-945b-4c71-8706-e2b8278277a2', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711b5176-2ea8-4c8f-932c-df8f856d078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (711b5176-2ea8-4c8f-932c-df8f856d078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f7a61-8620-418d-9b85-07ef4bd7ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Volume 76526903-945b-4c71-8706-e2b8278277a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76526903-945b-4c71-8706-e2b8278277a2', 'volume_size': 1} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (38adb04c-fd04-4809-8ca3-b677c1bcf4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bef45b-7160-4378-bc71-67ad1b7cd580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bef45b-7160-4378-bc71-67ad1b7cd580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-402793374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae90cde-97e2-44aa-8346-694f608fd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24729993-ddb3-47aa-a14c-acd2011cf867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24729993-ddb3-47aa-a14c-acd2011cf867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ecd8f1-fe12-4af3-9d50-992c6b103bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ecd8f1-fe12-4af3-9d50-992c6b103bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae90cde-97e2-44aa-8346-694f608fd843', 'volume_name': 'volume-7ae90cde-97e2-44aa-8346-694f608fd843', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f8fece-3030-47bd-b6c4-8dbaf3141191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f8fece-3030-47bd-b6c4-8dbaf3141191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6503712-9bf7-4eda-9b3d-0b8ccf4e8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Volume 7ae90cde-97e2-44aa-8346-694f608fd843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae90cde-97e2-44aa-8346-694f608fd843', 'volume_size': 1} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:12 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca" returned: 0 in 0.646s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1897977139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a4cc42-4333-4f4d-b815-d512e81c96ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:11Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Creating volume f5a4cc42-4333-4f4d-b815-d512e81c96ef {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:12 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2211f99d-545a-41d8-9f14-048b209c3a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491f629a-0ee3-4a81-adb2-d183767f1fca', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef 1073741824 Apr 28 16:21:12 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e3d05-1ef8-42dc-bc23-a576d6ba30dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:12 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Volume volume-491f629a-0ee3-4a81-adb2-d183767f1fca (491f629a-0ee3-4a81-adb2-d183767f1fca): created successfully Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e3d05-1ef8-42dc-bc23-a576d6ba30dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:12 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (153617c1-509f-40ec-a38b-f0bb7f92863d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:12 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-bc0b3155-7e8c-4442-abda-23ee3a7eb2ad tempest-CreateVolumesFromImageTest-1487285984 None] Created volume successfully. Apr 28 16:21:13 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef 1073741824" returned: 0 in 0.803s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:13 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef Apr 28 16:21:13 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:14 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef" returned: 0 in 0.616s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.422s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1110174191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Creating volume 36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:14 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598bc06c-9bf8-4604-9b11-8890473e6ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:14 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 1073741824 Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367c4792-e812-4682-b44f-fc105b48e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:14 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Volume volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef (f5a4cc42-4333-4f4d-b815-d512e81c96ef): created successfully Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367c4792-e812-4682-b44f-fc105b48e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (15f5eeea-9306-406d-aaa8-d4cd43be65fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:14 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b85f2a50-2b03-4580-8018-fc8de6ec6da5 tempest-CreateVolumesFromImageTest-1487285984 None] Created volume successfully. Apr 28 16:21:15 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 1073741824" returned: 0 in 0.767s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:15 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 Apr 28 16:21:15 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:15 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" returned: 0 in 0.592s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-689562645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76526903-945b-4c71-8706-e2b8278277a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Creating volume 76526903-945b-4c71-8706-e2b8278277a2 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:15 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1afd0c-3974-40c6-9fa8-1892500e17c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:15 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 1073741824 Apr 28 16:21:15 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7413cfc6-6a92-4f58-b0b2-efba4e91feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Volume volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 (36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1): created successfully Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7413cfc6-6a92-4f58-b0b2-efba4e91feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (717be906-0d91-4d76-b785-253440805ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-89d2bf6d-76ee-4dcc-82fc-588737215c39 tempest-CreateVolumesFromImageTest-1487285984 None] Created volume successfully. Apr 28 16:21:16 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 1073741824" returned: 0 in 0.839s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:16 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 Apr 28 16:21:16 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:17 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2" returned: 0 in 0.608s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.598s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-402793374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae90cde-97e2-44aa-8346-694f608fd843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1307271815d453abbce514c8e25879c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:12Z,use_quota=True,user_id='267442a2aadc4b039e6fa3e3cea68f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Creating volume 7ae90cde-97e2-44aa-8346-694f608fd843 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:17 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f7a61-8620-418d-9b85-07ef4bd7ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76526903-945b-4c71-8706-e2b8278277a2', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:17 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 1073741824 Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fce5a4-0233-40aa-88df-8245aa5232f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:17 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:17 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Volume volume-76526903-945b-4c71-8706-e2b8278277a2 (76526903-945b-4c71-8706-e2b8278277a2): created successfully Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fce5a4-0233-40aa-88df-8245aa5232f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (b8eee245-a90b-4f44-b252-db02873384a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:17 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-da9115b9-e8ce-4f9b-83e7-b82db3bcc846 tempest-CreateVolumesFromImageTest-1487285984 None] Created volume successfully. Apr 28 16:21:18 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 1073741824" returned: 0 in 0.787s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:18 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 Apr 28 16:21:18 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:18 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843" returned: 0 in 0.571s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6503712-9bf7-4eda-9b3d-0b8ccf4e8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae90cde-97e2-44aa-8346-694f608fd843', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d0dde-bf3d-4df7-ae59-3af122f8e16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:18 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Volume volume-7ae90cde-97e2-44aa-8346-694f608fd843 (7ae90cde-97e2-44aa-8346-694f608fd843): created successfully Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941d0dde-bf3d-4df7-ae59-3af122f8e16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Flow 'volume_create_manager' (38adb04c-fd04-4809-8ca3-b677c1bcf4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f2725425-ffac-4ac3-9c57-fbbc90684525 tempest-CreateVolumesFromImageTest-1487285984 None] Created volume successfully. Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-7ae90cde-97e2-44aa-8346-694f608fd843-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-7ae90cde-97e2-44aa-8346-694f608fd843-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-quobyte-7ae90cde-97e2-44aa-8346-694f608fd843" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-7ae90cde-97e2-44aa-8346-694f608fd843" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba214678-0a0b-4eef-8804-41f05c8563cf]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:19 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 Apr 28 16:21:19 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:19 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843" returned: 0 in 0.693s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:19 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843 Apr 28 16:21:19 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:20 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7ae90cde-97e2-44aa-8346-694f608fd843" returned: 0 in 0.600s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-7ae90cde-97e2-44aa-8346-694f608fd843" released by "delete_volume" :: held 1.329s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Created reservations ['9f4e6399-aaf2-4423-8436-9a2f24b31d53', '838d34ba-c610-41e3-8e73-23d410adb78b', '84b4645a-568c-4f45-b2e9-7007157ca5c4', 'f4850c3c-8284-4f10-9f73-95b76de81e47'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:20 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:20 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:21 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.566s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Deleted volume successfully. Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d16d3842-947a-4035-a704-91e7bbace063 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-7ae90cde-97e2-44aa-8346-694f608fd843-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-76526903-945b-4c71-8706-e2b8278277a2-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-76526903-945b-4c71-8706-e2b8278277a2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-quobyte-76526903-945b-4c71-8706-e2b8278277a2" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-76526903-945b-4c71-8706-e2b8278277a2" acquired by "delete_volume" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c6672e-6f12-4fc0-bc04-53204a0d021a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:21 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 Apr 28 16:21:21 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:22 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2" returned: 0 in 0.671s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:22 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2 Apr 28 16:21:22 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:22 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-76526903-945b-4c71-8706-e2b8278277a2" returned: 0 in 0.572s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-76526903-945b-4c71-8706-e2b8278277a2" released by "delete_volume" :: held 1.279s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Created reservations ['c6259a77-23a8-4e5d-ac64-5a1ab0c0f104', '59056e9b-770b-4df8-8662-f5ec6be5b08e', '800a160c-8622-4969-9d68-709a414461e7', '4fce7aea-7390-43a8-81e6-84dba57edf45'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:22 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:22 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:23 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.556s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Deleted volume successfully. Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-21cfeea8-4717-458b-a36b-3024d698b8c2 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-76526903-945b-4c71-8706-e2b8278277a2-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-quobyte-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[633395e7-02c8-4a00-bdd3-04cf799d7929]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:23 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 Apr 28 16:21:23 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:24 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" returned: 0 in 0.706s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:24 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1 Apr 28 16:21:24 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:24 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" returned: 0 in 0.576s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1" released by "delete_volume" :: held 1.322s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:24 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Created reservations ['899c144b-4cff-4a21-8f87-35c63ace03c9', '87375a7d-98f9-47a0-99be-12959058baa0', '44aeb384-e572-49bc-8caa-4327aff65904', '31277550-3708-4ea1-80c7-c0aa487893b1'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:25 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:25 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:25 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.569s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Deleted volume successfully. Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-218b104d-0e08-4cae-b6d5-8e2f4543bf47 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-36aba6fa-d07e-4fe9-92b6-aa0c1cd5d4e1-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-f5a4cc42-4333-4f4d-b815-d512e81c96ef-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-f5a4cc42-4333-4f4d-b815-d512e81c96ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-quobyte-f5a4cc42-4333-4f4d-b815-d512e81c96ef" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-f5a4cc42-4333-4f4d-b815-d512e81c96ef" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a51a8-ecb8-428f-8cbe-597f6b93a8d7]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:26 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef Apr 28 16:21:26 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:26 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef" returned: 0 in 0.684s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:26 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef Apr 28 16:21:26 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:27 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-f5a4cc42-4333-4f4d-b815-d512e81c96ef" returned: 0 in 0.576s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-f5a4cc42-4333-4f4d-b815-d512e81c96ef" released by "delete_volume" :: held 1.301s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Created reservations ['7284bf23-c5cb-4909-8f40-e79545f3ccc9', 'c7bcacd7-f288-4309-902f-a2e6d28a7232', 'c8812e5a-112a-41ca-a671-273f52ef5b03', '86c932c6-5ead-4554-925b-2e45d814716b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:27 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:27 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:27 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.567s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:27 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Deleted volume successfully. Apr 28 16:21:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9422e241-ce83-4cb5-9d65-c5eb6994a5d4 tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-f5a4cc42-4333-4f4d-b815-d512e81c96ef-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-491f629a-0ee3-4a81-adb2-d183767f1fca-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-491f629a-0ee3-4a81-adb2-d183767f1fca-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "cinder-quobyte-491f629a-0ee3-4a81-adb2-d183767f1fca" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-491f629a-0ee3-4a81-adb2-d183767f1fca" acquired by "delete_volume" :: waited 0.012s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec114e1d-1cb3-47a0-aa57-3b65bd1183ae]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:28 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca Apr 28 16:21:28 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:28 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:28 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca Apr 28 16:21:28 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:29 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-491f629a-0ee3-4a81-adb2-d183767f1fca" returned: 0 in 0.575s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-quobyte-491f629a-0ee3-4a81-adb2-d183767f1fca" released by "delete_volume" :: held 1.279s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Created reservations ['5283a846-4278-4f8a-a57c-5deff28094b9', '787b7604-0a7c-4c9f-9af5-524c6df93875', '78be29f9-eae4-4d41-94b7-4df672d32bf4', 'd31cd352-74db-41a2-aaa3-bf2c31c010dd'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:29 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:29 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:30 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.595s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:30 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Deleted volume successfully. Apr 28 16:21:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-b3359577-45d8-451e-be3c-4fb86602005f tempest-CreateVolumesFromImageTest-1487285984 None] Lock "cinder-491f629a-0ee3-4a81-adb2-d183767f1fca-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (fc95a80f-1309-4a48-833a-e08b80f0abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fe4cf7-d409-4962-9169-9fc272adcd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fe4cf7-d409-4962-9169-9fc272adcd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702477902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0a892a-d953-4dcc-b12e-0fa4d74eb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:33Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433805be-a41d-47c9-9307-7910a8dd9708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433805be-a41d-47c9-9307-7910a8dd9708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdba058d-b7f7-4f84-b599-fc0a53e20821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdba058d-b7f7-4f84-b599-fc0a53e20821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0a892a-d953-4dcc-b12e-0fa4d74eb55f', 'volume_name': 'volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca165f6-8cac-49e2-b641-d6de75ca7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca165f6-8cac-49e2-b641-d6de75ca7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc9d2c-70ea-4b9a-bf3d-45cab94b41cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:32 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume 6f0a892a-d953-4dcc-b12e-0fa4d74eb55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f', 'volume_size': 1} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702477902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0a892a-d953-4dcc-b12e-0fa4d74eb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:33Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume 6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:32 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:32 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f 1073741824 Apr 28 16:21:32 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:33 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f 1073741824" returned: 0 in 0.766s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:33 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f Apr 28 16:21:33 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:34 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" returned: 0 in 0.586s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc9d2c-70ea-4b9a-bf3d-45cab94b41cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e0839-6b7b-41cc-96c5-27c184b236c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:34 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f (6f0a892a-d953-4dcc-b12e-0fa4d74eb55f): created successfully Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948e0839-6b7b-41cc-96c5-27c184b236c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (fc95a80f-1309-4a48-833a-e08b80f0abd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a800743f-b958-4b32-8a1f-ac4b41c20832 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating offline snapshot 0f299d5a-da93-47d6-9c4c-382606f4621b of volume 6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0b674-9d45-416a-9859-4a32e9126cbf]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:35 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f Apr 28 16:21:35 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:35 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" returned: 0 in 0.682s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:35 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b 1G Apr 28 16:21:35 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:36 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b 1G" returned: 0 in 0.741s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:36 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b Apr 28 16:21:36 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:37 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b" returned: 0 in 0.615s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:37 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b is being set with open permissions: ugo+rw Apr 28 16:21:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:37 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b Apr 28 16:21:37 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:37 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b" returned: 0 in 0.600s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:37 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info Apr 28 16:21:37 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:38 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info" returned: 0 in 0.594s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:38 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info is being set with open permissions: ugo+rw Apr 28 16:21:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:38 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info Apr 28 16:21:38 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:38 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.info" returned: 0 in 0.571s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d53e5818-1b4a-492d-bd7c-d9900e5a21f9 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Create snapshot completed successfully Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (34cda87c-fccc-4b14-a3c4-e7559bb7aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1084a1-8b44-4fae-a5f7-5f1509331252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1084a1-8b44-4fae-a5f7-5f1509331252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375008436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa46f92b-ea8b-4132-9ff5-d3d23e69f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:39Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ec58f-cbe7-4f46-b7c4-12df86e3cf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ec58f-cbe7-4f46-b7c4-12df86e3cf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a581e09-967d-49b2-9e26-2c101d676475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a581e09-967d-49b2-9e26-2c101d676475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa46f92b-ea8b-4132-9ff5-d3d23e69f932', 'volume_name': 'volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a0da6e-6aec-4db2-a8d9-88a1cf37b962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a0da6e-6aec-4db2-a8d9-88a1cf37b962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614c3067-2792-437e-af50-3f22c5835b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume fa46f92b-ea8b-4132-9ff5-d3d23e69f932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932', 'volume_size': 1} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375008436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa46f92b-ea8b-4132-9ff5-d3d23e69f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:39Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume fa46f92b-ea8b-4132-9ff5-d3d23e69f932 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:39 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:39 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 1073741824 Apr 28 16:21:39 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (f91d7e1b-80dd-427d-92d1-86da85a37e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e89916-3e54-4aa0-aab0-63755142ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e89916-3e54-4aa0-aab0-63755142ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169902266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86111e8-c75c-4044-b3bd-06c9ba3025b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:40Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7c082-7a9b-448d-b406-85221b72eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b7c082-7a9b-448d-b406-85221b72eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab54c92-e040-4f22-97b5-81730a8f2134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab54c92-e040-4f22-97b5-81730a8f2134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86111e8-c75c-4044-b3bd-06c9ba3025b8', 'volume_name': 'volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1368b2-bfb3-4f6d-8543-415254121d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1368b2-bfb3-4f6d-8543-415254121d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12480a9a-e787-465f-b2f1-52f9018affd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume a86111e8-c75c-4044-b3bd-06c9ba3025b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8', 'volume_size': 1} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (1772a9f4-9d6d-4501-85a1-3b252779e032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96df83c0-1b20-40ba-9eb2-e5389db0d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96df83c0-1b20-40ba-9eb2-e5389db0d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1183044600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d173571-5797-4d44-a0dc-13e6f020ed51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:40Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a8a09-9e08-4497-bfbc-037ed83eb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a8a09-9e08-4497-bfbc-037ed83eb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6617584-e5d6-41d7-8f21-4228203e57cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6617584-e5d6-41d7-8f21-4228203e57cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d173571-5797-4d44-a0dc-13e6f020ed51', 'volume_name': 'volume-4d173571-5797-4d44-a0dc-13e6f020ed51', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6bdd89-6e0d-4b99-ba27-044f98abd453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6bdd89-6e0d-4b99-ba27-044f98abd453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f4e06b-4cd0-4a9d-b998-367d7dc02094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume 4d173571-5797-4d44-a0dc-13e6f020ed51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d173571-5797-4d44-a0dc-13e6f020ed51', 'volume_size': 1} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:40 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 1073741824" returned: 0 in 0.881s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:40 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 Apr 28 16:21:40 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (32bf40c6-3979-479d-91f1-237dcf245b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f43893d-6039-4f71-8573-3dfade57c4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f43893d-6039-4f71-8573-3dfade57c4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259860903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556950f8-d8f7-4f57-a3bc-c9f10cc038be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:41Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10885b0-d46c-480c-85e4-a6ce936e630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10885b0-d46c-480c-85e4-a6ce936e630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d5a3b-3ce1-4b17-a477-dff956e045ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679d5a3b-3ce1-4b17-a477-dff956e045ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556950f8-d8f7-4f57-a3bc-c9f10cc038be', 'volume_name': 'volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa904a-1e89-4d33-b4ef-05a6398712de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fa904a-1e89-4d33-b4ef-05a6398712de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee8a84d-0bc9-4e17-a6a4-9c04c1ee17f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume 556950f8-d8f7-4f57-a3bc-c9f10cc038be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be', 'volume_size': 1} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (05f1fc9a-afff-46c5-9259-38c93d757711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91eb4f-0e73-4d38-9dd4-3f0a13a85471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb91eb4f-0e73-4d38-9dd4-3f0a13a85471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024829904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48579e7f-a6ac-4a51-8c56-81b82f3a30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:41Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:40 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edf8896-c64a-42f6-ab43-1fe88b20f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5edf8896-c64a-42f6-ab43-1fe88b20f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54d9b18-fbc4-445f-aab6-082e012cb8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54d9b18-fbc4-445f-aab6-082e012cb8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48579e7f-a6ac-4a51-8c56-81b82f3a30dd', 'volume_name': 'volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df04e9d-0f11-4b3c-8af0-8894dc842f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df04e9d-0f11-4b3c-8af0-8894dc842f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf6ca72-bd9a-4309-91c9-a009b98d00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:41 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume 48579e7f-a6ac-4a51-8c56-81b82f3a30dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd', 'volume_size': 1} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:41 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" returned: 0 in 0.661s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1169902266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86111e8-c75c-4044-b3bd-06c9ba3025b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:40Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume a86111e8-c75c-4044-b3bd-06c9ba3025b8 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:41 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614c3067-2792-437e-af50-3f22c5835b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:41 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 1073741824 Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3cc996-447e-4525-9e5c-841954bffdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:41 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:41 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 (fa46f92b-ea8b-4132-9ff5-d3d23e69f932): created successfully Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3cc996-447e-4525-9e5c-841954bffdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:41 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (34cda87c-fccc-4b14-a3c4-e7559bb7aad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:41 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4d376823-12ae-43d3-a201-d32bde8986b1 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:42 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 1073741824" returned: 0 in 0.800s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:42 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 Apr 28 16:21:42 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:42 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8" returned: 0 in 0.574s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1183044600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d173571-5797-4d44-a0dc-13e6f020ed51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:40Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume 4d173571-5797-4d44-a0dc-13e6f020ed51 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:42 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:42 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 1073741824 Apr 28 16:21:42 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12480a9a-e787-465f-b2f1-52f9018affd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b157ca-64e6-4098-8da4-dd79be8e3404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:42 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 (a86111e8-c75c-4044-b3bd-06c9ba3025b8): created successfully Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b157ca-64e6-4098-8da4-dd79be8e3404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:42 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (f91d7e1b-80dd-427d-92d1-86da85a37e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e886753d-5dd1-4bf1-a9f1-8ab653ac97e6 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:43 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 1073741824" returned: 0 in 0.762s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:43 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 Apr 28 16:21:43 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:43 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51" returned: 0 in 0.576s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.320s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259860903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556950f8-d8f7-4f57-a3bc-c9f10cc038be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:41Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume 556950f8-d8f7-4f57-a3bc-c9f10cc038be {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:44 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:44 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be 1073741824 Apr 28 16:21:44 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f4e06b-4cd0-4a9d-b998-367d7dc02094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d173571-5797-4d44-a0dc-13e6f020ed51', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf64ab-fe8e-4c84-8b7a-470135a2c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:44 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-4d173571-5797-4d44-a0dc-13e6f020ed51 (4d173571-5797-4d44-a0dc-13e6f020ed51): created successfully Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbf64ab-fe8e-4c84-8b7a-470135a2c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (1772a9f4-9d6d-4501-85a1-3b252779e032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-21e9a77e-97a7-4d4e-a8a6-985af6d44ace tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:44 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be 1073741824" returned: 0 in 0.760s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:44 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be Apr 28 16:21:44 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:45 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be" returned: 0 in 0.607s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.385s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024829904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48579e7f-a6ac-4a51-8c56-81b82f3a30dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517424cda09d4a07802d171ab9218b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:21:41Z,use_quota=True,user_id='c8330515b1f24fe1a2e790957d2ecd81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Creating volume 48579e7f-a6ac-4a51-8c56-81b82f3a30dd {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:21:45 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee8a84d-0bc9-4e17-a6a4-9c04c1ee17f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51e65c9-7660-4044-9d3b-80004207037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:45 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd 1073741824 Apr 28 16:21:45 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:45 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be (556950f8-d8f7-4f57-a3bc-c9f10cc038be): created successfully Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51e65c9-7660-4044-9d3b-80004207037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (32bf40c6-3979-479d-91f1-237dcf245b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-506ac92f-f9e0-4742-b096-f7a8a172f043 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:46 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd 1073741824" returned: 0 in 0.749s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:46 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd Apr 28 16:21:46 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:46 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" returned: 0 in 0.577s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf6ca72-bd9a-4309-91c9-a009b98d00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13091ebd-be6f-4d63-9cb7-e2058e9230ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:21:46 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Volume volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd (48579e7f-a6ac-4a51-8c56-81b82f3a30dd): created successfully Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13091ebd-be6f-4d63-9cb7-e2058e9230ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:21:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Flow 'volume_create_manager' (05f1fc9a-afff-46c5-9259-38c93d757711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:21:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-38592c9d-ce4c-4f46-ba9a-36d6587860dc tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created volume successfully. Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-48579e7f-a6ac-4a51-8c56-81b82f3a30dd-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-48579e7f-a6ac-4a51-8c56-81b82f3a30dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a08427-c5bf-433b-b039-a32bf4aac20f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:47 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd Apr 28 16:21:47 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:48 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" returned: 0 in 0.691s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:48 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd Apr 28 16:21:48 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:48 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" returned: 0 in 0.576s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-48579e7f-a6ac-4a51-8c56-81b82f3a30dd" released by "delete_volume" :: held 1.303s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:48 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['46e7d3c3-5a7d-4977-b3ca-d581c8c21e57', 'fe0b802d-6e6f-40fe-b7be-dcdfc405a350', '5e67b4d7-087a-43dd-b4c5-3733383b9d6c', '991e17e3-87ae-4669-810e-0647f56c6b5d'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:49 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:49 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:49 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.573s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-9e3a6fd3-8676-4848-984f-3a79d079f048 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-48579e7f-a6ac-4a51-8c56-81b82f3a30dd-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-556950f8-d8f7-4f57-a3bc-c9f10cc038be-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-556950f8-d8f7-4f57-a3bc-c9f10cc038be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-556950f8-d8f7-4f57-a3bc-c9f10cc038be" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-556950f8-d8f7-4f57-a3bc-c9f10cc038be" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[039017de-2860-4f43-8d8e-963855c08b7d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:49 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be Apr 28 16:21:49 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:50 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be" returned: 0 in 0.683s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:50 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be Apr 28 16:21:50 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:51 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-556950f8-d8f7-4f57-a3bc-c9f10cc038be" returned: 0 in 0.597s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-556950f8-d8f7-4f57-a3bc-c9f10cc038be" released by "delete_volume" :: held 1.315s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['a542cba4-beb9-450f-8010-fe83b415e65f', 'c4a40a7d-2a14-4dd4-a3a3-e6c31f0a8332', '5816edf3-cf2f-48d4-b2cb-0c51cbf3512a', 'f438ed40-9a5c-4222-b318-30aa500416bf'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:51 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:51 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:51 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.577s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c277b257-f2bf-458f-b101-c1862a6d0bb8 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-556950f8-d8f7-4f57-a3bc-c9f10cc038be-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-4d173571-5797-4d44-a0dc-13e6f020ed51-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-4d173571-5797-4d44-a0dc-13e6f020ed51-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-4d173571-5797-4d44-a0dc-13e6f020ed51" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-4d173571-5797-4d44-a0dc-13e6f020ed51" acquired by "delete_volume" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af36ff-696f-4b3c-b23b-0e57075f65aa]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:52 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 Apr 28 16:21:52 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:52 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51" returned: 0 in 0.676s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:52 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51 Apr 28 16:21:52 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:53 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4d173571-5797-4d44-a0dc-13e6f020ed51" returned: 0 in 0.608s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-4d173571-5797-4d44-a0dc-13e6f020ed51" released by "delete_volume" :: held 1.321s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['70593e1a-a87b-4874-ac6c-6e0aeb4d0f6a', 'a346a55c-1e94-413e-9cfd-ce93c6085891', '77757b49-0cdf-4804-857d-399b806ef692', 'adc7fb58-ed54-4a8d-96ae-1b378a84778a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:53 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:53 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:54 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.611s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-eb80e68e-8e03-4916-93a9-e9956b6c86fe tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-4d173571-5797-4d44-a0dc-13e6f020ed51-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-a86111e8-c75c-4044-b3bd-06c9ba3025b8-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-a86111e8-c75c-4044-b3bd-06c9ba3025b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-a86111e8-c75c-4044-b3bd-06c9ba3025b8" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-a86111e8-c75c-4044-b3bd-06c9ba3025b8" acquired by "delete_volume" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[28254b8b-b6d5-47c2-b5b6-814c23cda977]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:54 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 Apr 28 16:21:54 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:54 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8" returned: 0 in 0.701s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:54 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8 Apr 28 16:21:54 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:55 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86111e8-c75c-4044-b3bd-06c9ba3025b8" returned: 0 in 0.575s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-a86111e8-c75c-4044-b3bd-06c9ba3025b8" released by "delete_volume" :: held 1.314s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['aa6fb562-0609-45d0-9e32-22f38d36826b', '800c45dc-e924-4515-822b-a8c6ec07e08b', 'bd71c884-7fda-477a-87ee-ae67c1de5e01', '1ad8baf6-8a8b-4e33-9731-dea8a91abca7'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:55 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:55 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:56 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.568s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:56 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7323ba3a-b1bb-4449-8f8e-110eee476413 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-a86111e8-c75c-4044-b3bd-06c9ba3025b8-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-fa46f92b-ea8b-4132-9ff5-d3d23e69f932-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-fa46f92b-ea8b-4132-9ff5-d3d23e69f932-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5f76d3-0c48-40eb-818f-b48d7ff8791c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:56 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 Apr 28 16:21:56 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:57 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" returned: 0 in 0.709s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:57 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932 Apr 28 16:21:57 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:57 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" returned: 0 in 0.578s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-fa46f92b-ea8b-4132-9ff5-d3d23e69f932" released by "delete_volume" :: held 1.326s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['c6a69a2e-1a57-482e-96f4-5cb7c51c5469', '4d328c6a-48a4-4bed-88d5-56810215a146', '5ae6d9d5-aa85-4963-8713-081e966cb8ac', '06bda94f-4f8b-465d-a7ce-efb04ecf4882'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:21:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:57 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:21:57 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:58 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.567s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:21:58 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fff6ea07-d729-40e6-adc6-dfcddb8832fd tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-fa46f92b-ea8b-4132-9ff5-d3d23e69f932-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-0f299d5a-da93-47d6-9c4c-382606f4621b-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-0f299d5a-da93-47d6-9c4c-382606f4621b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-0f299d5a-da93-47d6-9c4c-382606f4621b" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-0f299d5a-da93-47d6-9c4c-382606f4621b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleting offline snapshot 0f299d5a-da93-47d6-9c4c-382606f4621b of volume 6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] snapshot_file for this snap is: volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9563811-b756-44fb-8c8e-82dbfd61c473]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:58 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b Apr 28 16:21:58 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:21:59 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Apr 28 16:21:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b" returned: 0 in 0.680s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:21:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:21:59 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe7a89-312f-44c8-b634-8e5e5c7b47bd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:21:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:21:59 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f Apr 28 16:21:59 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:00 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" returned: 0 in 0.683s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:00 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b Apr 28 16:22:00 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:00 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:00 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:00 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b" returned: 0 in 0.655s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:00 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b Apr 28 16:22:00 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:01 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.605s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:01 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f.0f299d5a-da93-47d6-9c4c-382606f4621b" returned: 0 in 0.604s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-0f299d5a-da93-47d6-9c4c-382606f4621b" released by "_delete_snapshot" :: held 2.717s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" released by "delete_snapshot" :: held 2.738s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['fa676c14-ae09-40d2-b036-d5d8092af844', '6f7f3119-cca2-42fa-ba9d-e993421ab52c', 'bc5f482d-d105-4c9f-b855-7d0330a413e6', '739d7d21-655b-4523-a8f8-8916d93a0758'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Delete snapshot completed successfully. Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e2103047-f620-4416-9d19-71b81487a580 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-0f299d5a-da93-47d6-9c4c-382606f4621b-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d3113a-2745-4833-b71b-8347242cf5d9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:01 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f Apr 28 16:22:02 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:02 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" returned: 0 in 0.683s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:02 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f Apr 28 16:22:02 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:03 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" returned: 0 in 0.589s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-quobyte-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f" released by "delete_volume" :: held 1.329s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Created reservations ['325d47c5-f648-49a9-b083-53af0632e529', 'a3d0c35f-6366-406c-8c79-6a85c9fca4ec', '9a5e49f6-7a5c-4206-8039-afe4904e6b60', '74fed8e0-c26e-4260-82c9-79dfb653a18b'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:03 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:03 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:03 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.582s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Deleted volume successfully. Apr 28 16:22:03 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-58193993-a6b2-466b-a70a-9adf79cb6ea4 tempest-CreateVolumesFromSnapshotTest-1282081330 None] Lock "cinder-6f0a892a-d953-4dcc-b12e-0fa4d74eb55f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:13 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=91,cinder:INSERT=33,cinder:UPDATE=149,cinder:DELETE=10 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:22:13 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=98,cinder:INSERT=35,cinder:UPDATE=137,cinder:DELETE=15 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (be9503f3-fb30-4d1f-8d23-75edb828a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c37ed9d-77eb-47e2-b833-d6941758fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c37ed9d-77eb-47e2-b833-d6941758fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-151765390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352ea665-ef84-44e2-9bf9-c517be8c37db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:14Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b26e91-dcb4-432f-91b6-55f6759cd9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b26e91-dcb4-432f-91b6-55f6759cd9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6f698-328b-4ec3-ac83-75144c7c1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6f698-328b-4ec3-ac83-75144c7c1451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352ea665-ef84-44e2-9bf9-c517be8c37db', 'volume_name': 'volume-352ea665-ef84-44e2-9bf9-c517be8c37db', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6316eb-ba8d-43fa-8895-dacdef580468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6316eb-ba8d-43fa-8895-dacdef580468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f665d80b-b564-4dda-bea5-0c8bfa541260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Volume 352ea665-ef84-44e2-9bf9-c517be8c37db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352ea665-ef84-44e2-9bf9-c517be8c37db', 'volume_size': 1} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-151765390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352ea665-ef84-44e2-9bf9-c517be8c37db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:14Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Creating volume 352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:14 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:14 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db 1073741824 Apr 28 16:22:14 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (015c7c91-a405-4c34-b73b-25d430c1f498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d83f1ea-ca9b-40a7-ba9d-de1f64d72d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d83f1ea-ca9b-40a7-ba9d-de1f64d72d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147114027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86bf22c-fcea-4498-ac22-934932f8e3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03991de0-afe7-4008-a80b-76167446eeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03991de0-afe7-4008-a80b-76167446eeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0adfd6-c1a6-43dc-991c-a5bc0f15ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0adfd6-c1a6-43dc-991c-a5bc0f15ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86bf22c-fcea-4498-ac22-934932f8e3e6', 'volume_name': 'volume-a86bf22c-fcea-4498-ac22-934932f8e3e6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5c48eb-c79f-4b67-8c27-adb3f85e2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce5c48eb-c79f-4b67-8c27-adb3f85e2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964ce5e9-366c-48cd-b688-8f9949ec8391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume a86bf22c-fcea-4498-ac22-934932f8e3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86bf22c-fcea-4498-ac22-934932f8e3e6', 'volume_size': 1} Apr 28 16:22:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (3fb828cb-f470-4075-ad5e-be0b163b479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72f6029-1841-48a9-aeef-7f5afaafd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72f6029-1841-48a9-aeef-7f5afaafd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701371162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6590cc5e-db25-4e0f-a1ec-442757301f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe354a06-b332-436a-be5b-14c5903add02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe354a06-b332-436a-be5b-14c5903add02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d0a22f-cfe2-42db-a68a-50ace529ada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d0a22f-cfe2-42db-a68a-50ace529ada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6590cc5e-db25-4e0f-a1ec-442757301f8c', 'volume_name': 'volume-6590cc5e-db25-4e0f-a1ec-442757301f8c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cac9a61-76e4-4f64-a9ba-615124340c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cac9a61-76e4-4f64-a9ba-615124340c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a530587-6667-4e17-ae10-77f5ef4455e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Volume 6590cc5e-db25-4e0f-a1ec-442757301f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6590cc5e-db25-4e0f-a1ec-442757301f8c', 'volume_size': 1} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (a2b6d3dc-ee0d-4573-bf81-4f2750e89226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9510a5-5bff-4642-a76a-5ba8294d0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9510a5-5bff-4642-a76a-5ba8294d0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724616440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaa2631-c986-4947-aa84-1fa29cbc8087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce3215-f0be-4375-87c9-d005d46dee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce3215-f0be-4375-87c9-d005d46dee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9c693c-5bb3-48a6-82b0-615a8cb880ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9c693c-5bb3-48a6-82b0-615a8cb880ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eaa2631-c986-4947-aa84-1fa29cbc8087', 'volume_name': 'volume-7eaa2631-c986-4947-aa84-1fa29cbc8087', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d48530-8d73-4b8e-b35e-e3285dd38bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d48530-8d73-4b8e-b35e-e3285dd38bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404b827d-5333-4480-b160-d80da23f12b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:15 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Volume 7eaa2631-c986-4947-aa84-1fa29cbc8087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eaa2631-c986-4947-aa84-1fa29cbc8087', 'volume_size': 1} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:15 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db 1073741824" returned: 0 in 1.188s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:15 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:15 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (ff618cea-ca88-4569-a8b0-a8412c4ab2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:15 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100cd638-f11a-4bbc-a350-636c433cb604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100cd638-f11a-4bbc-a350-636c433cb604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-952944064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91729eba-5879-460d-b7d1-a20db3c45379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:16Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84fba3e-9de9-49d0-8513-cf03e9185d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d84fba3e-9de9-49d0-8513-cf03e9185d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3f351e-4e40-4fed-b4b7-587acaf3e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3f351e-4e40-4fed-b4b7-587acaf3e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91729eba-5879-460d-b7d1-a20db3c45379', 'volume_name': 'volume-91729eba-5879-460d-b7d1-a20db3c45379', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0768094-8cb3-4369-b79b-fb0f0cb7f273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0768094-8cb3-4369-b79b-fb0f0cb7f273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1be9d3-5b30-4ea6-8a65-3047b7a48618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Volume 91729eba-5879-460d-b7d1-a20db3c45379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91729eba-5879-460d-b7d1-a20db3c45379', 'volume_size': 1} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (ac10f973-7340-4cf2-9267-fa4c46009512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e601b0a9-ea29-4b0f-8f68-9bdb44718a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e601b0a9-ea29-4b0f-8f68-9bdb44718a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944158317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122ffdb9-7300-4b1c-9e5f-7a6f43532dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:16Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fc11fb-e550-432e-902e-5cb3d6fb03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fc11fb-e550-432e-902e-5cb3d6fb03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1a8348-3cab-42eb-a791-26cd6bb136c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1a8348-3cab-42eb-a791-26cd6bb136c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122ffdb9-7300-4b1c-9e5f-7a6f43532dfe', 'volume_name': 'volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183343b-0670-44c7-aa76-83231af17118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183343b-0670-44c7-aa76-83231af17118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fb7354-94b7-4753-87e4-6ac1752d755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Volume 122ffdb9-7300-4b1c-9e5f-7a6f43532dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe', 'volume_size': 1} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:16 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.898s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147114027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86bf22c-fcea-4498-ac22-934932f8e3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:16 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:16 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 1073741824 Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f665d80b-b564-4dda-bea5-0c8bfa541260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352ea665-ef84-44e2-9bf9-c517be8c37db', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc2fe5-92b0-43fd-bd02-4592c0a6467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Volume volume-352ea665-ef84-44e2-9bf9-c517be8c37db (352ea665-ef84-44e2-9bf9-c517be8c37db): created successfully Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dc2fe5-92b0-43fd-bd02-4592c0a6467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (be9503f3-fb30-4d1f-8d23-75edb828a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:16 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-8d3e4c14-4d6a-4a84-afd1-63c4a6a096b2 tempest-VolumeDependencyTests-1223462525 None] Created volume successfully. Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (c1b26a8b-6403-4cbc-9dd1-377cc470663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f0185d-7d99-4e46-8214-e695ca5dbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f0185d-7d99-4e46-8214-e695ca5dbd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864405516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeee6347-b367-4ba4-8556-26a2a5431921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:17Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:16 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d2c6d0-a048-49d2-800e-11254790c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d2c6d0-a048-49d2-800e-11254790c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a75afef-956b-4141-b55a-73430fd418a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a75afef-956b-4141-b55a-73430fd418a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeee6347-b367-4ba4-8556-26a2a5431921', 'volume_name': 'volume-eeee6347-b367-4ba4-8556-26a2a5431921', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc53df0d-dc18-480a-8e06-c1dba092b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc53df0d-dc18-480a-8e06-c1dba092b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77efa5ff-2f68-47e3-8a56-6ad5927e99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:17 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Volume eeee6347-b367-4ba4-8556-26a2a5431921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeee6347-b367-4ba4-8556-26a2a5431921', 'volume_size': 1} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:17 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 1073741824" returned: 0 in 0.897s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:17 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 Apr 28 16:22:17 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:18 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6" returned: 0 in 0.644s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.106s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701371162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6590cc5e-db25-4e0f-a1ec-442757301f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Creating volume 6590cc5e-db25-4e0f-a1ec-442757301f8c {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:18 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964ce5e9-366c-48cd-b688-8f9949ec8391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86bf22c-fcea-4498-ac22-934932f8e3e6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:18 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c 1073741824 Apr 28 16:22:18 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e792f61-c9df-4492-a98b-d02594c4ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:18 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 (a86bf22c-fcea-4498-ac22-934932f8e3e6): created successfully Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e792f61-c9df-4492-a98b-d02594c4ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:18 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (015c7c91-a405-4c34-b73b-25d430c1f498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:18 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5856554f-a34e-4650-88cd-bc914dec8e86 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:19 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c 1073741824" returned: 0 in 0.842s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:19 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c Apr 28 16:22:19 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:19 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c" returned: 0 in 0.697s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.388s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724616440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaa2631-c986-4947-aa84-1fa29cbc8087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:15Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Creating volume 7eaa2631-c986-4947-aa84-1fa29cbc8087 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:19 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:19 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 1073741824 Apr 28 16:22:19 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a530587-6667-4e17-ae10-77f5ef4455e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6590cc5e-db25-4e0f-a1ec-442757301f8c', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:19 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95f6626-3e54-48b0-ab05-008f9e117909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:19 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Volume volume-6590cc5e-db25-4e0f-a1ec-442757301f8c (6590cc5e-db25-4e0f-a1ec-442757301f8c): created successfully Apr 28 16:22:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95f6626-3e54-48b0-ab05-008f9e117909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:20 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (3fb828cb-f470-4075-ad5e-be0b163b479b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:20 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ee59575e-e3ab-4fd0-bd70-43e21d490a16 tempest-CreateVolumesFromImageTest-387828754 None] Created volume successfully. Apr 28 16:22:20 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 1073741824" returned: 0 in 0.816s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:20 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 Apr 28 16:22:20 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:21 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087" returned: 0 in 0.624s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-952944064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91729eba-5879-460d-b7d1-a20db3c45379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:16Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Creating volume 91729eba-5879-460d-b7d1-a20db3c45379 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:21 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404b827d-5333-4480-b160-d80da23f12b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaa2631-c986-4947-aa84-1fa29cbc8087', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d829956a-70e7-4d2c-b915-04f0279c4453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:21 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 1073741824 Apr 28 16:22:21 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:21 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Volume volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 (7eaa2631-c986-4947-aa84-1fa29cbc8087): created successfully Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d829956a-70e7-4d2c-b915-04f0279c4453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:21 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (a2b6d3dc-ee0d-4573-bf81-4f2750e89226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-dd9dabdd-3f91-4117-abcb-1c311051287a tempest-CreateVolumesFromImageTest-387828754 None] Created volume successfully. Apr 28 16:22:22 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 1073741824" returned: 0 in 0.873s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:22 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 Apr 28 16:22:22 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:22 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379" returned: 0 in 0.606s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.416s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944158317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122ffdb9-7300-4b1c-9e5f-7a6f43532dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:16Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Creating volume 122ffdb9-7300-4b1c-9e5f-7a6f43532dfe {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:22 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:22 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe 1073741824 Apr 28 16:22:22 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:22 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1be9d3-5b30-4ea6-8a65-3047b7a48618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91729eba-5879-460d-b7d1-a20db3c45379', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f099aa20-4dd1-4e69-8e3e-1e8b2f42e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:23 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Volume volume-91729eba-5879-460d-b7d1-a20db3c45379 (91729eba-5879-460d-b7d1-a20db3c45379): created successfully Apr 28 16:22:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f099aa20-4dd1-4e69-8e3e-1e8b2f42e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:23 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (ff618cea-ca88-4569-a8b0-a8412c4ab2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:23 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-dfc32b6d-3fcb-4943-b80f-6541216111cd tempest-CreateVolumesFromImageTest-387828754 None] Created volume successfully. Apr 28 16:22:23 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe 1073741824" returned: 0 in 0.862s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:23 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe Apr 28 16:22:23 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:24 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" returned: 0 in 0.784s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.610s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864405516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeee6347-b367-4ba4-8556-26a2a5431921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a11ec7191b43c1a26cd4bab66a9230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:17Z,use_quota=True,user_id='22320d5550cc46db90c5f6854bbd6503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Creating volume eeee6347-b367-4ba4-8556-26a2a5431921 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:24 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:24 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 1073741824 Apr 28 16:22:24 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fb7354-94b7-4753-87e4-6ac1752d755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e38ec-852f-45dc-b070-7eca581ae3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:24 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Volume volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe (122ffdb9-7300-4b1c-9e5f-7a6f43532dfe): created successfully Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248e38ec-852f-45dc-b070-7eca581ae3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:24 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (ac10f973-7340-4cf2-9267-fa4c46009512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-209561c9-cbf5-4c71-ab78-86b566b4808a tempest-CreateVolumesFromImageTest-387828754 None] Created volume successfully. Apr 28 16:22:25 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 1073741824" returned: 0 in 0.791s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:25 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 Apr 28 16:22:25 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:26 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921" returned: 0 in 0.659s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.995s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77efa5ff-2f68-47e3-8a56-6ad5927e99c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeee6347-b367-4ba4-8556-26a2a5431921', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd8ac74-c324-4ba1-8ac9-cd80d779cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Creating offline snapshot 7e890378-f1ac-4625-9461-49f373c7e596 of volume 352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:22:26 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Volume volume-eeee6347-b367-4ba4-8556-26a2a5431921 (eeee6347-b367-4ba4-8556-26a2a5431921): created successfully Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd8ac74-c324-4ba1-8ac9-cd80d779cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Flow 'volume_create_manager' (c1b26a8b-6403-4cbc-9dd1-377cc470663f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b2d598-79e3-4d12-af1a-a2204043c146]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:26 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-66547024-2589-4500-a5de-51af9fa37820 tempest-CreateVolumesFromImageTest-387828754 None] Created volume successfully. Apr 28 16:22:26 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:26 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-eeee6347-b367-4ba4-8556-26a2a5431921-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-eeee6347-b367-4ba4-8556-26a2a5431921-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-quobyte-eeee6347-b367-4ba4-8556-26a2a5431921" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-eeee6347-b367-4ba4-8556-26a2a5431921" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fa55a-9bf9-4c34-92c2-55395994608f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:27 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 Apr 28 16:22:27 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:27 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.829s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:27 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 1G Apr 28 16:22:27 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:27 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921" returned: 0 in 0.758s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:27 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921 Apr 28 16:22:27 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:27 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 1G" returned: 0 in 0.851s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352ea665-ef84-44e2-9bf9-c517be8c37db -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:27 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352ea665-ef84-44e2-9bf9-c517be8c37db -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:27 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:28 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-eeee6347-b367-4ba4-8556-26a2a5431921" returned: 0 in 0.652s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-eeee6347-b367-4ba4-8556-26a2a5431921" released by "delete_volume" :: held 1.462s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Created reservations ['d7af2c80-d910-4221-ae5f-061ecef0146f', 'e433f719-550e-4065-a8c5-0f61afe5dc6f', 'fb2894ca-991c-4a1e-a346-8c60ebec28ed', 'aa95326a-76bf-48b9-b5f6-788c8a12c597'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:28 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:28 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:28 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352ea665-ef84-44e2-9bf9-c517be8c37db -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 0.738s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:28 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 is being set with open permissions: ugo+rw Apr 28 16:22:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:28 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:28 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-quobyte-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e3eb3-6027-4406-80b0-7ad3005fd534]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:29 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.682s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:29 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Deleted volume successfully. Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-072e056e-4428-472d-84f5-5bf36893dba5 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-eeee6347-b367-4ba4-8556-26a2a5431921-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:29 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe Apr 28 16:22:29 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:29 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 0.712s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:29 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info Apr 28 16:22:29 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:29 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" returned: 0 in 0.746s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:29 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe Apr 28 16:22:29 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:30 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:30 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info is being set with open permissions: ugo+rw Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:30 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info Apr 28 16:22:30 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:30 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" returned: 0 in 0.708s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe" released by "delete_volume" :: held 1.504s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Created reservations ['bee95954-b4fd-422f-a2ec-7260cc501eb0', '0f46f3fb-26b1-454a-81b0-292ab43bcc0e', 'd227f8c8-a73e-46b9-95b8-2381ffedc4e7', '6d91287d-143b-4308-af28-51c065957518'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:30 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:30 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:30 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.info" returned: 0 in 0.807s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.532s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating offline snapshot 503a109d-120b-4ec8-9df2-171c7496ce46 of volume a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:22:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-fd2dfbc8-d296-4553-b716-a54577411425 tempest-VolumeDependencyTests-1223462525 None] Create snapshot completed successfully Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df9aff-3d92-40f7-83d3-204df914ce13]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:31 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 Apr 28 16:22:31 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-91729eba-5879-460d-b7d1-a20db3c45379-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-91729eba-5879-460d-b7d1-a20db3c45379-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-quobyte-91729eba-5879-460d-b7d1-a20db3c45379" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-91729eba-5879-460d-b7d1-a20db3c45379" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e660c964-1037-4ace-a77c-cacfbcf6a1eb]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:31 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.672s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:31 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Deleted volume successfully. Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dc97db43-0f4e-4c6b-8a62-ced66fe2701e tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-122ffdb9-7300-4b1c-9e5f-7a6f43532dfe-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:31 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 Apr 28 16:22:31 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:31 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6" returned: 0 in 0.858s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:31 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 1G Apr 28 16:22:31 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:32 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379" returned: 0 in 0.929s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:32 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379 Apr 28 16:22:32 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (b6bad860-5bdd-4798-b4b7-055535be0d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737bb4fb-bbfa-4180-bbf9-06d146734c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737bb4fb-bbfa-4180-bbf9-06d146734c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-573327526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2daf01-e364-448e-be85-e1215c0c9d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e890378-f1ac-4625-9461-49f373c7e596,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:32Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b2f42f-eb73-4806-ae35-97754499ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b2f42f-eb73-4806-ae35-97754499ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71226560-2d10-482b-92a3-c776575cf665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71226560-2d10-482b-92a3-c776575cf665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb2daf01-e364-448e-be85-e1215c0c9d56', 'volume_name': 'volume-bb2daf01-e364-448e-be85-e1215c0c9d56', 'volume_size': 1, 'snapshot_id': '7e890378-f1ac-4625-9461-49f373c7e596'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b5944b-968a-459c-b812-dabdda490f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b5944b-968a-459c-b812-dabdda490f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f63c01b-a835-4249-9e99-24cd9d7bccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:32 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Volume bb2daf01-e364-448e-be85-e1215c0c9d56: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb2daf01-e364-448e-be85-e1215c0c9d56', 'volume_size': 1, 'snapshot_id': '7e890378-f1ac-4625-9461-49f373c7e596'} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:32 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 1G" returned: 0 in 1.170s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:33 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 Apr 28 16:22:33 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:33 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-91729eba-5879-460d-b7d1-a20db3c45379" returned: 0 in 0.731s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-91729eba-5879-460d-b7d1-a20db3c45379" released by "delete_volume" :: held 1.730s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Created reservations ['7a1286dc-42ca-47aa-98eb-debf43d54d42', 'bef64ff9-d3f7-4e0b-8955-d68d3b5cbf0b', 'aa3e59b2-e403-4452-9214-585e9c06ee23', 'ad8c0ca5-9b8c-46e8-bddb-742717e914e2'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:33 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:33 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-7eaa2631-c986-4947-aa84-1fa29cbc8087-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:33 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46" returned: 0 in 0.735s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 is being set with open permissions: ugo+rw Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-7eaa2631-c986-4947-aa84-1fa29cbc8087-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:33 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 Apr 28 16:22:33 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-quobyte-7eaa2631-c986-4947-aa84-1fa29cbc8087" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-7eaa2631-c986-4947-aa84-1fa29cbc8087" acquired by "delete_volume" :: waited 0.027s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3749a404-1419-495f-aeb6-fc88f14dde67]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:34 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 Apr 28 16:22:34 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:34 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.783s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Deleted volume successfully. Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-602fae9b-27ac-4d8c-93f7-e5c7fe202cc9 tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-91729eba-5879-460d-b7d1-a20db3c45379-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:34 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:34 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info Apr 28 16:22:34 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:34 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087" returned: 0 in 0.809s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:34 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087 Apr 28 16:22:34 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:35 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info" returned: 0 in 0.648s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:35 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info is being set with open permissions: ugo+rw Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:35 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info Apr 28 16:22:35 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:35 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-7eaa2631-c986-4947-aa84-1fa29cbc8087" returned: 0 in 0.675s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-7eaa2631-c986-4947-aa84-1fa29cbc8087" released by "delete_volume" :: held 1.543s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Created reservations ['1f8609db-c9f9-4cbb-b8e0-31373ac1bf27', '3d7f8b4e-53e5-4afb-8929-a861a2e0033e', '011c8ac8-975e-41dc-87c9-c38107f80ef8', '190cad3e-f16a-4454-abd8-ef98f1397877'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:35 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:35 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:35 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.info" returned: 0 in 0.655s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.869s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.087s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596-bb2daf01-e364-448e-be85-e1215c0c9d56" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596-bb2daf01-e364-448e-be85-e1215c0c9d56" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Creating volume bb2daf01-e364-448e-be85-e1215c0c9d56 from snapshot 7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-be494148-7724-42a9-8fb8-5aee5abf9c2d tempest-CreateVolumesFromSnapshotTest-917110251 None] Create snapshot completed successfully Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] snapshot: 7e890378-f1ac-4625-9461-49f373c7e596, volume: bb2daf01-e364-448e-be85-e1215c0c9d56, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[35feedf7-1b7f-41bd-ac31-c5349f805616]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-6590cc5e-db25-4e0f-a1ec-442757301f8c-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-6590cc5e-db25-4e0f-a1ec-442757301f8c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "cinder-quobyte-6590cc5e-db25-4e0f-a1ec-442757301f8c" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:36 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:36 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-6590cc5e-db25-4e0f-a1ec-442757301f8c" acquired by "delete_volume" :: waited 0.029s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e836dcb-0c2e-4d7e-bcff-df7c6c384f64]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:36 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.793s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:36 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Deleted volume successfully. Apr 28 16:22:36 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c Apr 28 16:22:36 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-baf3c292-000c-4aa9-ba3d-3deb83e0bbee tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-7eaa2631-c986-4947-aa84-1fa29cbc8087-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (1584800b-0f8c-4f90-bf4c-95073a8c0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1788e78b-2768-45c0-a221-68ab863085d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1788e78b-2768-45c0-a221-68ab863085d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514396904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a143f715-d073-4548-818f-34926ce3f3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:37Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf0abc7-5b9d-4a4c-be9d-02aded031b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf0abc7-5b9d-4a4c-be9d-02aded031b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddb36b9-0dc4-4754-bb57-0785eadfc45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddb36b9-0dc4-4754-bb57-0785eadfc45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a143f715-d073-4548-818f-34926ce3f3d9', 'volume_name': 'volume-a143f715-d073-4548-818f-34926ce3f3d9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415c2456-d4f3-4c66-9c37-1551e86d5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415c2456-d4f3-4c66-9c37-1551e86d5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d698fde5-0752-4f74-ab30-711516e51685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:36 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume a143f715-d073-4548-818f-34926ce3f3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a143f715-d073-4548-818f-34926ce3f3d9', 'volume_size': 1} Apr 28 16:22:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:37 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 1.174s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352ea665-ef84-44e2-9bf9-c517be8c37db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb7227-00e7-469d-ab1b-49d7b51bc9e0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:37 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (8c141615-fae6-4fce-8839-e45ea8b29f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eae709e-b346-46cc-97d4-5b0c85b778c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c" returned: 0 in 1.095s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eae709e-b346-46cc-97d4-5b0c85b778c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065231132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de3c1f5-116c-419d-8d23-0a46e6f2c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:37Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48c8f28-75da-450f-8c14-c40789f48745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48c8f28-75da-450f-8c14-c40789f48745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:37 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c Apr 28 16:22:37 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f98ad-0823-4bbb-9cb2-4916c7f9bc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f98ad-0823-4bbb-9cb2-4916c7f9bc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de3c1f5-116c-419d-8d23-0a46e6f2c7c4', 'volume_name': 'volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2adc40-5203-49cf-a310-b8439b269df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2adc40-5203-49cf-a310-b8439b269df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:37 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:37 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ee95e3-356f-4345-b295-a7570769d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume 6de3c1f5-116c-419d-8d23-0a46e6f2c7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4', 'volume_size': 1} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (d5965d0e-6155-4aaa-842c-b7f872e2e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fa4fa4-e985-46cb-8f10-0602595806a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fa4fa4-e985-46cb-8f10-0602595806a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367724713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1f274c-73a9-4fc5-98f1-6c07c7158fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:38Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d043c0-397a-45a1-9a9c-9ed873d58c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d043c0-397a-45a1-9a9c-9ed873d58c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9d08b1-7eb2-465b-a527-c09f6dec4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9d08b1-7eb2-465b-a527-c09f6dec4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1f274c-73a9-4fc5-98f1-6c07c7158fe6', 'volume_name': 'volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a2309a-077f-41c2-800a-1c60375ae24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a2309a-077f-41c2-800a-1c60375ae24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d388b9-35b7-4277-b951-0c50542124b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume bc1f274c-73a9-4fc5-98f1-6c07c7158fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6', 'volume_size': 1} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:38 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6590cc5e-db25-4e0f-a1ec-442757301f8c" returned: 0 in 0.868s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-quobyte-6590cc5e-db25-4e0f-a1ec-442757301f8c" released by "delete_volume" :: held 2.022s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Created reservations ['f6c49b2f-1e47-414c-84dd-b319e53483cb', 'da54904d-a6b7-4ea0-8c4a-f63dbb617893', '8fd13754-6d34-4f4a-8757-316179dc8505', '763e0645-25fa-441b-9383-abd5878c4dd9'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:38 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 1.175s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:38 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 Apr 28 16:22:38 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:38 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:38 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (4e3f2d25-ddac-4377-ae0b-cd000ebf862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47030342-89cf-427d-ab7f-294f9cff937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47030342-89cf-427d-ab7f-294f9cff937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477771405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b726ade-b432-46ea-8d1b-55565a3ba3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:38Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bfa2a2-886d-45a5-9a12-b36a6d586a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bfa2a2-886d-45a5-9a12-b36a6d586a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7fb236-6e8c-4985-8078-2fdf60868ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7fb236-6e8c-4985-8078-2fdf60868ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b726ade-b432-46ea-8d1b-55565a3ba3c9', 'volume_name': 'volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0b5f6c-c40c-4190-8b25-f4c2558cb9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0b5f6c-c40c-4190-8b25-f4c2558cb9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d308fa-abb9-4761-a817-6a494d40e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:38 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume 4b726ade-b432-46ea-8d1b-55565a3ba3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9', 'volume_size': 1} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (f95f80c9-473c-4b46-a6d8-58878f97e5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cb91a2-63f7-4d58-a86d-0650660bee95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cb91a2-63f7-4d58-a86d-0650660bee95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545271855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd996a39-6149-45b6-aa9b-e226a8256c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:39Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be90286-5c63-44c9-ab2e-c2dbe27b3736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be90286-5c63-44c9-ab2e-c2dbe27b3736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33220bde-dea1-4c83-b2f6-c022d5d7b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33220bde-dea1-4c83-b2f6-c022d5d7b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd996a39-6149-45b6-aa9b-e226a8256c5a', 'volume_name': 'volume-cd996a39-6149-45b6-aa9b-e226a8256c5a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a14fc-cf3f-4861-b167-2c8676dd2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a14fc-cf3f-4861-b167-2c8676dd2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ac029-d09b-4c74-b33f-a0716da07d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume cd996a39-6149-45b6-aa9b-e226a8256c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd996a39-6149-45b6-aa9b-e226a8256c5a', 'volume_size': 1} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:39 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.867s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:39 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Deleted volume successfully. Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Flow 'volume_create_manager' (98d31a55-d6c6-4baa-beb2-4ebb24a5e7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bee99d-7dbf-4a83-b277-e1371c08b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bee99d-7dbf-4a83-b277-e1371c08b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2121849849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174ac090-0796-416a-b2cf-0bdec150ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73fa8ac240a4a03a2ebb9706ef2d38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:39Z,use_quota=True,user_id='b5116f4720c143aa860f4b5494750fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ba7a85-e11a-402f-acd9-d2368b156ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ba7a85-e11a-402f-acd9-d2368b156ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ffe4a7-ee57-4183-8d2a-12a2f9b86cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ffe4a7-ee57-4183-8d2a-12a2f9b86cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174ac090-0796-416a-b2cf-0bdec150ebe3', 'volume_name': 'volume-174ac090-0796-416a-b2cf-0bdec150ebe3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442258dc-b0a2-432c-a612-1019898eb8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442258dc-b0a2-432c-a612-1019898eb8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b21a692-2e55-4933-bacb-851d6af6ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:39 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Volume 174ac090-0796-416a-b2cf-0bdec150ebe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174ac090-0796-416a-b2cf-0bdec150ebe3', 'volume_size': 1} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f77f355-6bb8-4ff1-9d2a-166b8f1acaca tempest-CreateVolumesFromImageTest-387828754 None] Lock "cinder-6590cc5e-db25-4e0f-a1ec-442757301f8c-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:43 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56" returned: 0 in 5.645s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:43 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4624421e-b3fb-4a33-8f5b-439a7d654515]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:44 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:44 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (bff3581e-4a15-4dab-8237-3a4374370e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e27c334-6ab5-4fe9-a036-cb4d61270635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e27c334-6ab5-4fe9-a036-cb4d61270635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185277913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141381db-bce3-4d5d-a19d-c143dff120a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:44Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a657ae-e40e-446c-a41c-92bffc1ea677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a657ae-e40e-446c-a41c-92bffc1ea677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cd66b1-633e-4325-9685-28720fb9ba44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cd66b1-633e-4325-9685-28720fb9ba44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141381db-bce3-4d5d-a19d-c143dff120a9', 'volume_name': 'volume-141381db-bce3-4d5d-a19d-c143dff120a9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b53bd85-4f13-4cd4-bac8-f3c679fb91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b53bd85-4f13-4cd4-bac8-f3c679fb91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf3baa9-7453-4c18-ada4-071bfe516c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:44 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume 141381db-bce3-4d5d-a19d-c143dff120a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141381db-bce3-4d5d-a19d-c143dff120a9', 'volume_size': 1} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:44 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.865s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:22:44 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Converted 1024.00 MB image at 181.37 MB/s Apr 28 16:22:44 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 is being set with open permissions: ugo+rw Apr 28 16:22:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:44 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 Apr 28 16:22:44 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:45 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56" returned: 0 in 0.577s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" released by "_copy_volume_from_snapshot" :: held 9.579s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596-bb2daf01-e364-448e-be85-e1215c0c9d56" released by "_create_volume_from_snapshot" :: held 9.628s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.661s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.527s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514396904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a143f715-d073-4548-818f-34926ce3f3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:37Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume a143f715-d073-4548-818f-34926ce3f3d9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:45 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:45 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 1073741824 Apr 28 16:22:45 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f63c01b-a835-4249-9e99-24cd9d7bccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2daf01-e364-448e-be85-e1215c0c9d56', 'volume_size': 1, 'snapshot_id': '7e890378-f1ac-4625-9461-49f373c7e596'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb9599-2c1a-476d-8f99-fa98c4942e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:45 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Volume volume-bb2daf01-e364-448e-be85-e1215c0c9d56 (bb2daf01-e364-448e-be85-e1215c0c9d56): created successfully Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb9599-2c1a-476d-8f99-fa98c4942e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (b6bad860-5bdd-4798-b4b7-055535be0d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:45 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c892d249-589a-40eb-a28a-f44227a0d6b2 tempest-VolumeDependencyTests-1223462525 None] Created volume successfully. Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-7e890378-f1ac-4625-9461-49f373c7e596-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-7e890378-f1ac-4625-9461-49f373c7e596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Deleting offline snapshot 7e890378-f1ac-4625-9461-49f373c7e596 of volume 352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] snapshot_file for this snap is: volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7b1db1-ddfb-4bac-9ada-68b033285982]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:46 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:46 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:46 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 1073741824" returned: 0 in 0.781s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:46 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 Apr 28 16:22:46 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:46 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 0.751s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352ea665-ef84-44e2-9bf9-c517be8c37db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992793f-505f-4a95-b903-eb3b8e26435d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:46 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:46 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:46 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9" returned: 0 in 0.590s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.503s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1065231132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de3c1f5-116c-419d-8d23-0a46e6f2c7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:37Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume 6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:46 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:46 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 1073741824 Apr 28 16:22:46 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d698fde5-0752-4f74-ab30-711516e51685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a143f715-d073-4548-818f-34926ce3f3d9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b658687-c482-47d2-b547-388242c1bd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:46 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-a143f715-d073-4548-818f-34926ce3f3d9 (a143f715-d073-4548-818f-34926ce3f3d9): created successfully Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b658687-c482-47d2-b547-388242c1bd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:46 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (1584800b-0f8c-4f90-bf4c-95073a8c0b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:46 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-63fe23c9-08bd-496a-b028-2f2fb5d119ce tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:47 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.725s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:47 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:47 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:47 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 1073741824" returned: 0 in 0.808s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:47 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 Apr 28 16:22:47 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:48 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 0.710s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:48 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596 Apr 28 16:22:48 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:48 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" returned: 0 in 0.605s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.270s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-367724713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1f274c-73a9-4fc5-98f1-6c07c7158fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:38Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:48 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ee95e3-356f-4345-b295-a7570769d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c931f3b-2ac6-49f7-afdf-cdb3fc061584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:48 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 1073741824 Apr 28 16:22:48 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:48 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 (6de3c1f5-116c-419d-8d23-0a46e6f2c7c4): created successfully Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c931f3b-2ac6-49f7-afdf-cdb3fc061584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (8c141615-fae6-4fce-8839-e45ea8b29f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-b5e1f159-5dbc-46db-87ca-3d1da88d1102 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:48 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db.7e890378-f1ac-4625-9461-49f373c7e596" returned: 0 in 0.582s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-7e890378-f1ac-4625-9461-49f373c7e596" released by "_delete_snapshot" :: held 2.892s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" released by "delete_snapshot" :: held 2.926s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Created reservations ['58dc879f-93a2-4e56-8325-c1e2d88cb1f3', '69d7043a-a3c5-449d-866d-1c37a591a9b8', '4a426a0c-05ce-46e3-979d-2817db835372', 'ddd0138d-50aa-4e15-937f-7d5fc4b308c0'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Delete snapshot completed successfully. Apr 28 16:22:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-4fd46a84-2f86-416a-8f70-85e654546ef3 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-7e890378-f1ac-4625-9461-49f373c7e596-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-352ea665-ef84-44e2-9bf9-c517be8c37db-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-352ea665-ef84-44e2-9bf9-c517be8c37db-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b241242-6272-4e03-8d7c-2fe860fa6c84]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:49 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 1073741824" returned: 0 in 0.873s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:49 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:49 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:49 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 Apr 28 16:22:49 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:49 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" returned: 0 in 0.594s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.221s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1477771405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b726ade-b432-46ea-8d1b-55565a3ba3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:38Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume 4b726ade-b432-46ea-8d1b-55565a3ba3c9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:49 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:49 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.739s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:49 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 1073741824 Apr 28 16:22:49 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d388b9-35b7-4277-b951-0c50542124b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6005038-545c-457d-ba2c-522572e8d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:49 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db Apr 28 16:22:49 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:49 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 (bc1f274c-73a9-4fc5-98f1-6c07c7158fe6): created successfully Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6005038-545c-457d-ba2c-522572e8d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:49 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (d5965d0e-6155-4aaa-842c-b7f872e2e65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:49 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c9b2fd02-4b00-4545-b700-264072c4f2a9 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:50 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-352ea665-ef84-44e2-9bf9-c517be8c37db" returned: 0 in 0.629s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-352ea665-ef84-44e2-9bf9-c517be8c37db" released by "delete_volume" :: held 1.432s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Created reservations ['d65f89de-d11e-4020-9d1f-3440222eaf3c', '7b966d8a-c6f4-4dd3-bf4a-734e26577850', '96f04b02-c0e8-42ec-a890-c9594c8d3ce2', 'f883e643-6db0-4043-8d74-45ffc0e9c0b8'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:50 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 1073741824" returned: 0 in 0.776s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:50 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:50 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:50 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 Apr 28 16:22:50 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:51 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.575s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Deleted volume successfully. Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e52324a8-f9a3-4e55-a790-85a23474a994 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-352ea665-ef84-44e2-9bf9-c517be8c37db-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:51 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9" returned: 0 in 0.617s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.201s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545271855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd996a39-6149-45b6-aa9b-e226a8256c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da560af3da04e21adccf6121b6b9e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:39Z,use_quota=True,user_id='ecc90432f41d4d81816e535769be87c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Creating volume cd996a39-6149-45b6-aa9b-e226a8256c5a {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:51 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d308fa-abb9-4761-a817-6a494d40e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a 1073741824 Apr 28 16:22:51 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb28063-4878-4793-9c60-49a4c95d7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 (4b726ade-b432-46ea-8d1b-55565a3ba3c9): created successfully Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb28063-4878-4793-9c60-49a4c95d7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (4e3f2d25-ddac-4377-ae0b-cd000ebf862b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3d13336e-820c-49f1-ba4e-9c472e3ba409 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (d0dafaf8-b381-416a-ad95-c0a5dab4e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cb3217-bf34-458e-848c-8c6ca0e802eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80cb3217-bf34-458e-848c-8c6ca0e802eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-394285223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b41fcb-1625-42b0-b5ca-fc5c08715863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:52Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb82592d-7106-453f-8342-017a409c3f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb82592d-7106-453f-8342-017a409c3f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c882c-0fc1-4778-a456-e60abefad03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4c882c-0fc1-4778-a456-e60abefad03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b41fcb-1625-42b0-b5ca-fc5c08715863', 'volume_name': 'volume-47b41fcb-1625-42b0-b5ca-fc5c08715863', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c9f2b6-fd64-4dac-b61c-a2679c248079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c9f2b6-fd64-4dac-b61c-a2679c248079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708bef68-d4d2-4ab0-be34-ea8a8f923326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:51 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Volume 47b41fcb-1625-42b0-b5ca-fc5c08715863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b41fcb-1625-42b0-b5ca-fc5c08715863', 'volume_size': 1} Apr 28 16:22:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:52 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a 1073741824" returned: 0 in 0.808s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:52 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a Apr 28 16:22:52 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:52 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a" returned: 0 in 0.584s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.304s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2121849849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174ac090-0796-416a-b2cf-0bdec150ebe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73fa8ac240a4a03a2ebb9706ef2d38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:39Z,use_quota=True,user_id='b5116f4720c143aa860f4b5494750fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Creating volume 174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:52 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:52 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 1073741824 Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6ac029-d09b-4c74-b33f-a0716da07d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd996a39-6149-45b6-aa9b-e226a8256c5a', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:52 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57a0fc2-a0d4-4bb0-98c4-239b7c66e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:52 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Volume volume-cd996a39-6149-45b6-aa9b-e226a8256c5a (cd996a39-6149-45b6-aa9b-e226a8256c5a): created successfully Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57a0fc2-a0d4-4bb0-98c4-239b7c66e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:52 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Flow 'volume_create_manager' (f95f80c9-473c-4b46-a6d8-58878f97e5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:52 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-85ce73d1-e36f-43c0-acdf-6b7ceeb21d3b tempest-CreateVolumesFromSnapshotTest-917110251 None] Created volume successfully. Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-cd996a39-6149-45b6-aa9b-e226a8256c5a-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-cd996a39-6149-45b6-aa9b-e226a8256c5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-cd996a39-6149-45b6-aa9b-e226a8256c5a" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-cd996a39-6149-45b6-aa9b-e226a8256c5a" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e198db-ec5d-4446-8594-615b1f4ac2e2]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:53 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a Apr 28 16:22:53 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:53 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 1073741824" returned: 0 in 0.832s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:53 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:22:53 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:54 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a" returned: 0 in 0.742s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:54 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a Apr 28 16:22:54 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:54 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.583s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.929s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185277913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141381db-bce3-4d5d-a19d-c143dff120a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:44Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume 141381db-bce3-4d5d-a19d-c143dff120a9 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:54 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b21a692-2e55-4933-bacb-851d6af6ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174ac090-0796-416a-b2cf-0bdec150ebe3', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:54 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 1073741824 Apr 28 16:22:54 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348e2aaf-43d3-4711-b648-8bd8477710ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:54 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Volume volume-174ac090-0796-416a-b2cf-0bdec150ebe3 (174ac090-0796-416a-b2cf-0bdec150ebe3): created successfully Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348e2aaf-43d3-4711-b648-8bd8477710ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Flow 'volume_create_manager' (98d31a55-d6c6-4baa-beb2-4ebb24a5e7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:54 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-79a5e9c1-524b-4ae5-99c2-a0ddd20d08a5 tempest-SnapshotDependencyTests-740370700 None] Created volume successfully. Apr 28 16:22:54 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-cd996a39-6149-45b6-aa9b-e226a8256c5a" returned: 0 in 0.627s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-cd996a39-6149-45b6-aa9b-e226a8256c5a" released by "delete_volume" :: held 1.431s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['7fd7ed2b-103f-4bc2-a373-3c391085bca6', 'dfa3ed0b-bf6d-41af-9ad1-28ca8b13735b', 'c9f350b2-9472-4fa6-9719-9b0b91953e64', '70f5c7fd-acc1-4e5c-bd33-c5a9c9b13296'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:54 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:54 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:54 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:55 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 1073741824" returned: 0 in 0.868s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:55 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 Apr 28 16:22:55 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-4b726ade-b432-46ea-8d1b-55565a3ba3c9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:55 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-4b726ade-b432-46ea-8d1b-55565a3ba3c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-4b726ade-b432-46ea-8d1b-55565a3ba3c9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-7639106d-a796-47ce-9506-bc0c07839dd2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-cd996a39-6149-45b6-aa9b-e226a8256c5a-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-4b726ade-b432-46ea-8d1b-55565a3ba3c9" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d769ae5-74fa-466a-aa7f-939b4d1a8b73]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:55 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9" returned: 0 in 0.636s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.015s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-394285223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b41fcb-1625-42b0-b5ca-fc5c08715863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:52Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Creating volume 47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:55 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 Apr 28 16:22:55 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:22:55 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:55 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 1073741824 Apr 28 16:22:55 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf3baa9-7453-4c18-ada4-071bfe516c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141381db-bce3-4d5d-a19d-c143dff120a9', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e57d8d-8e58-4759-bf09-c2488cc515b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:55 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-141381db-bce3-4d5d-a19d-c143dff120a9 (141381db-bce3-4d5d-a19d-c143dff120a9): created successfully Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e57d8d-8e58-4759-bf09-c2488cc515b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:55 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (bff3581e-4a15-4dab-8237-3a4374370e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:55 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-3492c0bd-894a-46d4-9de2-19a321d07369 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (1608f2f6-2b15-44da-94ca-19e8eacf6ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910bdad2-661b-4288-92a3-8e5b1afa120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910bdad2-661b-4288-92a3-8e5b1afa120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668066122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc9a37-3355-4e74-b017-168bba9a5485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:56Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e23683-58fb-4129-abc0-33a860ad06a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e23683-58fb-4129-abc0-33a860ad06a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a259337-5293-4a2b-8932-2947ca893408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a259337-5293-4a2b-8932-2947ca893408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfc9a37-3355-4e74-b017-168bba9a5485', 'volume_name': 'volume-8dfc9a37-3355-4e74-b017-168bba9a5485', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978a8e1-1eae-4ef1-ab23-ca70566d9486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978a8e1-1eae-4ef1-ab23-ca70566d9486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff1439-980b-4360-a30e-041b163295dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume 8dfc9a37-3355-4e74-b017-168bba9a5485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfc9a37-3355-4e74-b017-168bba9a5485', 'volume_size': 1} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9" returned: 0 in 0.805s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:56 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9 Apr 28 16:22:56 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:56 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 1073741824" returned: 0 in 0.901s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:56 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:22:56 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (04b8ec7d-c841-4911-9547-a85e2b365c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fb9334-be09-4ef9-886d-42fbf365e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fb9334-be09-4ef9-886d-42fbf365e080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040560103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015bd8b6-2644-465d-ae44-a57803d4dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:57Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be9821d-6357-4025-af8d-c5ba53a22034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be9821d-6357-4025-af8d-c5ba53a22034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a744cbd-ca20-4a27-a7fb-3912093e8320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a744cbd-ca20-4a27-a7fb-3912093e8320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015bd8b6-2644-465d-ae44-a57803d4dff6', 'volume_name': 'volume-015bd8b6-2644-465d-ae44-a57803d4dff6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853cc2f6-f601-4731-a191-e14c2b1ace32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853cc2f6-f601-4731-a191-e14c2b1ace32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dd04b1-c572-4c9d-85ce-68fefb137ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:56 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume 015bd8b6-2644-465d-ae44-a57803d4dff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015bd8b6-2644-465d-ae44-a57803d4dff6', 'volume_size': 1} Apr 28 16:22:56 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:57 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (3eea0bf1-8d3b-422a-b02b-da83e2d6cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0beb51ce-9a99-4d77-85f8-1f7a766e9171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b726ade-b432-46ea-8d1b-55565a3ba3c9" returned: 0 in 0.807s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0beb51ce-9a99-4d77-85f8-1f7a766e9171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771153263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5eda55-be6a-42dc-9012-56a675c55c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:57Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f2594e-27a1-46b3-ac96-171934e2c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f2594e-27a1-46b3-ac96-171934e2c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea036f8-da3a-435a-bdf0-3f6326e28cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea036f8-da3a-435a-bdf0-3f6326e28cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5eda55-be6a-42dc-9012-56a675c55c50', 'volume_name': 'volume-da5eda55-be6a-42dc-9012-56a675c55c50', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91812fa-5229-4e36-99ee-05658829018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91812fa-5229-4e36-99ee-05658829018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a284bf05-b8b0-4fe9-85ae-b00165720090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume da5eda55-be6a-42dc-9012-56a675c55c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5eda55-be6a-42dc-9012-56a675c55c50', 'volume_size': 1} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-4b726ade-b432-46ea-8d1b-55565a3ba3c9" released by "delete_volume" :: held 1.711s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['f8444037-3310-49f7-af84-6b8d1e397444', '56a494ca-74d1-4e28-9cc1-6a466957b3d3', '84353e66-2831-419f-9985-9a0340e22ff2', '30085c63-c493-40e2-b700-b89754e9ca5f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:57 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:57 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:57 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.793s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.702s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708bef68-d4d2-4ab0-be34-ea8a8f923326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b41fcb-1625-42b0-b5ca-fc5c08715863', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17920691-c73a-4edc-865b-ba365ae4094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Creating offline snapshot 1a232bf1-625b-483e-aec4-e2aa4f9511b9 of volume 174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:22:57 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Volume volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 (47b41fcb-1625-42b0-b5ca-fc5c08715863): created successfully Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17920691-c73a-4edc-865b-ba365ae4094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (d0dafaf8-b381-416a-ad95-c0a5dab4e25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6766b3ed-56a1-4547-af15-b9af91c8c677]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:57 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-fb828ea7-6cd8-4c70-982b-b09887d0452c tempest-VolumeDependencyTests-1223462525 None] Created volume successfully. Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (c9f00008-5e3b-4c8a-a6ca-9e8ad88ceb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4973c9a-61b3-4f48-b186-8b3d04721137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4973c9a-61b3-4f48-b186-8b3d04721137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823782564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e113e-8db3-48eb-a226-818f83e2d1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:58Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c141847-4310-45a3-bcbf-840eb23816ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c141847-4310-45a3-bcbf-840eb23816ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3ca1da-71ec-4ca8-ab67-58d95e384445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3ca1da-71ec-4ca8-ab67-58d95e384445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1e113e-8db3-48eb-a226-818f83e2d1b7', 'volume_name': 'volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:22:57 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814d5d9b-f1e4-4700-80dd-4cc971c803e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814d5d9b-f1e4-4700-80dd-4cc971c803e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eaa485-2ece-4983-aa2b-f82ce26759a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:57 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume 4b1e113e-8db3-48eb-a226-818f83e2d1b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7', 'volume_size': 1} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:57 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ccfee-a961-4fe5-adfa-c9f58fd8802f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (036fbbd5-555d-422e-9c0a-3b36e6d4e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492d952a-7709-4e9d-af39-04864a83c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 Apr 28 16:22:58 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492d952a-7709-4e9d-af39-04864a83c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786291088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480de1b7-dc04-4ca8-88a3-6a1ecc8197fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:58Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c3d744-2826-47e5-9d6f-bbbfa53aafef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c3d744-2826-47e5-9d6f-bbbfa53aafef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cb2b86-e0f6-48fe-9a69-fa2e1527d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47cb2b86-e0f6-48fe-9a69-fa2e1527d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480de1b7-dc04-4ca8-88a3-6a1ecc8197fe', 'volume_name': 'volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc324b-46ae-4f6d-99b4-a11a88d8554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fc324b-46ae-4f6d-99b4-a11a88d8554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fefb59f-4419-4901-82c2-abb0835e9dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume 480de1b7-dc04-4ca8-88a3-6a1ecc8197fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe', 'volume_size': 1} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:58 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.824s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:22:58 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-dd82308b-d5b6-48eb-a20e-d3a9b04dc995 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-4b726ade-b432-46ea-8d1b-55565a3ba3c9-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:58 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.966s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:58 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 1G Apr 28 16:22:58 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (0d388b5f-e348-43f6-80a1-0d45252c566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27cb8df-f860-4842-b06b-f3ae807281fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27cb8df-f860-4842-b06b-f3ae807281fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-571236321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd47e75d-cd54-43cd-8be1-d60d304c4f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c094d2a5c9f44f9f8e8f3c41e61a35ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=47b41fcb-1625-42b0-b5ca-fc5c08715863,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:59Z,use_quota=True,user_id='a1ab72cdecb84b8daecaacc9554dcd42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1592f2ec-e169-4578-a171-55e235a0cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1592f2ec-e169-4578-a171-55e235a0cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c1c32b-9c1c-4f44-8b86-a9fc82fa0ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c1c32b-9c1c-4f44-8b86-a9fc82fa0ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd47e75d-cd54-43cd-8be1-d60d304c4f22', 'volume_name': 'volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22', 'volume_size': 1, 'source_volid': '47b41fcb-1625-42b0-b5ca-fc5c08715863', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2655bff0-ac8b-483b-81e3-8b518ed36339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2655bff0-ac8b-483b-81e3-8b518ed36339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6fbc33-7d75-4e2e-90cf-2ea776aa8321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:22:58 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Volume bd47e75d-cd54-43cd-8be1-d60d304c4f22: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22', 'volume_size': 1, 'source_volid': '47b41fcb-1625-42b0-b5ca-fc5c08715863', 'source_volstatus': 'available'} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:58 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" returned: 0 in 0.811s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:58 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:58 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6 Apr 28 16:22:58 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:59 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 1G" returned: 0 in 0.779s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174ac090-0796-416a-b2cf-0bdec150ebe3 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:59 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174ac090-0796-416a-b2cf-0bdec150ebe3 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:22:59 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:59 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" returned: 0 in 0.594s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6" released by "delete_volume" :: held 1.482s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['d0311b87-90b0-4da9-befb-80aa39a650f1', 'f2ca48dd-7b40-4e91-a621-0e2916a20195', '26378665-ac23-4f82-af65-298909ef9808', '37b21c5d-c5f1-41e4-a830-cafafe60c6e5'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:22:59 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:22:59 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:22:59 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174ac090-0796-416a-b2cf-0bdec150ebe3 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.635s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:22:59 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 is being set with open permissions: ugo+rw Apr 28 16:22:59 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:00 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:23:00 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:00 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.641s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:00 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-e1bb27d7-a5af-4516-8783-fa81a4791ac2 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-bc1f274c-73a9-4fc5-98f1-6c07c7158fe6-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afffd84-bfa5-4981-b8c7-62a6ed517020]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:00 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 Apr 28 16:23:00 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:00 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.590s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:00 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info Apr 28 16:23:00 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:00 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:00 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:01 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" returned: 0 in 0.748s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:01 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4 Apr 28 16:23:01 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:01 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.601s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:01 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info" returned: 0 in 0.638s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:01 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info is being set with open permissions: ugo+rw Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:01 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info Apr 28 16:23:01 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:01 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" returned: 0 in 0.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4" released by "delete_volume" :: held 1.423s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['a070e570-059c-4a1b-82e5-4e2e591ec7f8', '19e7bd7d-3d06-4868-bb28-23dbdb760189', 'd07d5c26-765b-41b8-9691-ed378fc43874', '5b179059-76ac-46fd-8944-b97fe7e131c2'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:01 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:01 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:01 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.info" returned: 0 in 0.633s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.440s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668066122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc9a37-3355-4e74-b017-168bba9a5485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:56Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume 8dfc9a37-3355-4e74-b017-168bba9a5485 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:01 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:01 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 1073741824 Apr 28 16:23:01 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:01 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-e5c30bc3-f7f7-41f9-b0dd-be0eb2c2bbaa tempest-SnapshotDependencyTests-740370700 None] Create snapshot completed successfully Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-a143f715-d073-4548-818f-34926ce3f3d9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-a143f715-d073-4548-818f-34926ce3f3d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:02 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.685s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:02 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-a143f715-d073-4548-818f-34926ce3f3d9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-ce2dc717-9508-4309-b47c-57f40bb68165 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-6de3c1f5-116c-419d-8d23-0a46e6f2c7c4-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a143f715-d073-4548-818f-34926ce3f3d9" acquired by "delete_volume" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e02ffb-b57f-46b0-86d3-47b9ec53131c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:02 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 Apr 28 16:23:02 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Flow 'volume_create_manager' (78c318f6-aba5-4915-9b50-8dcf092e1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca16447a-2dae-4500-b758-6a21264c6f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca16447a-2dae-4500-b758-6a21264c6f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73fa8ac240a4a03a2ebb9706ef2d38d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a232bf1-625b-483e-aec4-e2aa4f9511b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:23:03Z,use_quota=True,user_id='b5116f4720c143aa860f4b5494750fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e217ded7-9eb5-4425-b2ef-cd41b65d40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e217ded7-9eb5-4425-b2ef-cd41b65d40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e696390-c995-42c4-bdb5-6311b4557e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e696390-c995-42c4-bdb5-6311b4557e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd078c3e7-9e6b-4df5-a06d-4c8f48c2ab58', 'volume_name': 'volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58', 'volume_size': 1, 'snapshot_id': '1a232bf1-625b-483e-aec4-e2aa4f9511b9'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ae2c98-26f8-44ed-98ba-496c726ef86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ae2c98-26f8-44ed-98ba-496c726ef86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:02 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99f53a-bbb1-41c3-8d4c-41d28e1b3c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:02 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Volume d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58', 'volume_size': 1, 'snapshot_id': '1a232bf1-625b-483e-aec4-e2aa4f9511b9'} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 1073741824" returned: 0 in 0.936s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:02 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:02 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 Apr 28 16:23:02 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:03 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9" returned: 0 in 0.754s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:03 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9 Apr 28 16:23:03 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:03 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485" returned: 0 in 0.632s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.610s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040560103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015bd8b6-2644-465d-ae44-a57803d4dff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:57Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume 015bd8b6-2644-465d-ae44-a57803d4dff6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:03 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ff1439-980b-4360-a30e-041b163295dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfc9a37-3355-4e74-b017-168bba9a5485', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:03 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 1073741824 Apr 28 16:23:03 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59e1fa-8091-4a35-9eb7-374e2e743e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:03 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-8dfc9a37-3355-4e74-b017-168bba9a5485 (8dfc9a37-3355-4e74-b017-168bba9a5485): created successfully Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd59e1fa-8091-4a35-9eb7-374e2e743e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (1608f2f6-2b15-44da-94ca-19e8eacf6ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:03 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2d15cb0a-7593-47ee-8457-f02e276a5d29 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:23:03 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:03 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a143f715-d073-4548-818f-34926ce3f3d9" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a143f715-d073-4548-818f-34926ce3f3d9" released by "delete_volume" :: held 1.467s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['e7bd3833-656c-42f1-b2f8-6ed0a60bbff4', '237d6fa6-1b8a-4bda-845b-9df7b48fa460', 'd6a46bbe-af8e-4592-910c-616bd3b857b3', 'ed84bba1-ca31-4158-9ae2-29f4ecc4a911'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:04 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:04 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:04 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 1073741824" returned: 0 in 0.839s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:04 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 Apr 28 16:23:04 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-503a109d-120b-4ec8-9df2-171c7496ce46-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:04 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.600s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-503a109d-120b-4ec8-9df2-171c7496ce46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:04 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-503a109d-120b-4ec8-9df2-171c7496ce46" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a06c6e23-4dea-4ffd-b3ce-fca79a5523f4 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-a143f715-d073-4548-818f-34926ce3f3d9-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-503a109d-120b-4ec8-9df2-171c7496ce46" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleting offline snapshot 503a109d-120b-4ec8-9df2-171c7496ce46 of volume a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] snapshot_file for this snap is: volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae348c-d5d6-416b-bbfb-7a6dbc953a7c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:04 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:04 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 Apr 28 16:23:04 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:05 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.748s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771153263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5eda55-be6a-42dc-9012-56a675c55c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:57Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume da5eda55-be6a-42dc-9012-56a675c55c50 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:05 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:05 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 1073741824 Apr 28 16:23:05 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44dd04b1-c572-4c9d-85ce-68fefb137ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015bd8b6-2644-465d-ae44-a57803d4dff6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac80d755-f1c2-43c8-bca9-c73e51d8b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:05 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-015bd8b6-2644-465d-ae44-a57803d4dff6 (015bd8b6-2644-465d-ae44-a57803d4dff6): created successfully Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac80d755-f1c2-43c8-bca9-c73e51d8b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (04b8ec7d-c841-4911-9547-a85e2b365c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:05 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5f830117-1a1d-46a0-bd47-0970eadca7a4 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:23:05 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46" returned: 0 in 0.749s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86bf22c-fcea-4498-ac22-934932f8e3e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992c6f2-5f87-4b2c-b8f5-79cdbb20d5c6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:05 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 Apr 28 16:23:05 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:05 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 1073741824" returned: 0 in 0.813s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:05 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:05 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 Apr 28 16:23:05 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:06 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6" returned: 0 in 0.728s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:06 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 Apr 28 16:23:06 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:06 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50" returned: 0 in 0.621s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.784s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823782564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e113e-8db3-48eb-a226-818f83e2d1b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:58Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume 4b1e113e-8db3-48eb-a226-818f83e2d1b7 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:06 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:06 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 1073741824 Apr 28 16:23:06 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a284bf05-b8b0-4fe9-85ae-b00165720090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5eda55-be6a-42dc-9012-56a675c55c50', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ffc53c-74e5-46df-8a15-88db227dc9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:06 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-da5eda55-be6a-42dc-9012-56a675c55c50 (da5eda55-be6a-42dc-9012-56a675c55c50): created successfully Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ffc53c-74e5-46df-8a15-88db227dc9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:06 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (3eea0bf1-8d3b-422a-b02b-da83e2d6cc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:06 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-163c30ca-7f33-467c-843e-ac793c148228 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:23:07 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46" returned: 0 in 0.723s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:07 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46 Apr 28 16:23:07 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:07 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 1073741824" returned: 0 in 0.826s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:07 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 Apr 28 16:23:07 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:07 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6.503a109d-120b-4ec8-9df2-171c7496ce46" returned: 0 in 0.641s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-503a109d-120b-4ec8-9df2-171c7496ce46" released by "_delete_snapshot" :: held 2.953s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" released by "delete_snapshot" :: held 2.993s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['64792874-22b0-40d5-b3d1-3a09a860ac4c', 'e17e7c7b-6528-4601-8d6d-24eab9c5499e', 'd8e36a5c-7e24-4a4c-a2f4-9ade02f8b70a', '46b2e454-e987-4e98-a640-f2d197e34274'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:07 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Delete snapshot completed successfully. Apr 28 16:23:07 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-fd46807f-1494-4ef0-bbc1-de8f2fde0a4f tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-503a109d-120b-4ec8-9df2-171c7496ce46-delete_snapshot" released by "delete_snapshot" :: held 3.164s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:08 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7" returned: 0 in 0.620s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.815s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786291088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480de1b7-dc04-4ca8-88a3-6a1ecc8197fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0118cfec17c49d099f5cc8d295a796f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:22:58Z,use_quota=True,user_id='accfb15f32434d08a8bde29779974088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Creating volume 480de1b7-dc04-4ca8-88a3-6a1ecc8197fe {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:08 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eaa485-2ece-4983-aa2b-f82ce26759a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:08 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe 1073741824 Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301f370c-4a46-46f1-b77a-53dc28be4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:08 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:08 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 (4b1e113e-8db3-48eb-a226-818f83e2d1b7): created successfully Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301f370c-4a46-46f1-b77a-53dc28be4329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (c9f00008-5e3b-4c8a-a6ca-9e8ad88ceb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:08 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-efa8d881-709a-4f2e-9f9c-053c6caea49a tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:23:08 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe 1073741824" returned: 0 in 0.771s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:08 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe Apr 28 16:23:08 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-a86bf22c-fcea-4498-ac22-934932f8e3e6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:08 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-a86bf22c-fcea-4498-ac22-934932f8e3e6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" acquired by "delete_volume" :: waited 0.016s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[91877b3f-2a1a-4a19-a554-60a76632c056]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:09 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 Apr 28 16:23:09 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:09 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" returned: 0 in 0.617s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.674s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:09 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Cloning volume 47b41fcb-1625-42b0-b5ca-fc5c08715863 to volume bd47e75d-cd54-43cd-8be1-d60d304c4f22 Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fefb59f-4419-4901-82c2-abb0835e9dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a525aec-78b3-4ff8-a101-64b2f4fae2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:09 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Volume volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe (480de1b7-dc04-4ca8-88a3-6a1ecc8197fe): created successfully Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a525aec-78b3-4ff8-a101-64b2f4fae2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Flow 'volume_create_manager' (036fbbd5-555d-422e-9c0a-3b36e6d4e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Creating offline snapshot d87e8e04-14b1-4dd3-a2de-584bac4a0324 of volume 47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:23:09 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-569cd418-3b78-4ec6-840a-af206dfa5c90 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created volume successfully. Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3e872-df33-435b-9a3e-93d670866e60]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:09 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:09 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:09 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6" returned: 0 in 0.743s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:09 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:09 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6 Apr 28 16:23:09 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" acquired by "delete_volume" :: waited 0.021s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d43c8-acec-4e0c-bfe3-a3700425d6b6]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:10 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.809s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:10 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 1G Apr 28 16:23:10 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:10 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe Apr 28 16:23:10 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:10 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-a86bf22c-fcea-4498-ac22-934932f8e3e6" returned: 0 in 0.768s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-quobyte-a86bf22c-fcea-4498-ac22-934932f8e3e6" released by "delete_volume" :: held 1.571s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Created reservations ['828fd253-c7ee-46ca-b612-38a412805093', 'c909b3a6-2ec6-45d8-b719-e2ffee69195a', '5039a3e7-5f77-4158-8cef-7a17a2ef2c71', '22984cf2-9578-43bd-bc74-1744da3d3404'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:10 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:10 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:10 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:11 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" returned: 0 in 0.758s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:11 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe Apr 28 16:23:11 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:11 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 1G" returned: 0 in 0.849s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:11 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:11 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:11 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.666s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:11 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Deleted volume successfully. Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-0c2c27ed-8341-414f-aa4a-0e8870ec4a57 tempest-CreateVolumesFromSnapshotTest-917110251 None] Lock "cinder-a86bf22c-fcea-4498-ac22-934932f8e3e6-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:11 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" returned: 0 in 0.744s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe" released by "delete_volume" :: held 1.559s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:11 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['3c3290af-12c2-49e9-a093-8b13910ee087', '8fd93387-f2f8-4f43-a269-e320ee33fce3', '81bf7da8-1eed-4c55-b7e8-959732549c5a', 'cf7d2d2f-fbbe-4588-b445-c21270457f98'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:12 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:12 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.811s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:12 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 is being set with open permissions: ugo+rw Apr 28 16:23:12 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:12 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:12 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-4b1e113e-8db3-48eb-a226-818f83e2d1b7-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-4b1e113e-8db3-48eb-a226-818f83e2d1b7-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-4b1e113e-8db3-48eb-a226-818f83e2d1b7" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-4b1e113e-8db3-48eb-a226-818f83e2d1b7" acquired by "delete_volume" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[64603eff-72f1-45b4-8c35-70c53670c15d]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:12 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.746s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:12 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:12 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.731s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-f846596a-e1f1-4523-bafe-64e6d2053fc2 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-480de1b7-dc04-4ca8-88a3-6a1ecc8197fe-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:12 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:12 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info Apr 28 16:23:12 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:12 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 Apr 28 16:23:12 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:13 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:13 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info is being set with open permissions: ugo+rw Apr 28 16:23:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:13 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info Apr 28 16:23:13 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:13 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7" returned: 0 in 0.790s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:13 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:13 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7 Apr 28 16:23:13 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:14 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.info" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:14 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-4b1e113e-8db3-48eb-a226-818f83e2d1b7" returned: 0 in 0.663s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] snapshot: d87e8e04-14b1-4dd3-a2de-584bac4a0324, volume: bd47e75d-cd54-43cd-8be1-d60d304c4f22, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-4b1e113e-8db3-48eb-a226-818f83e2d1b7" released by "delete_volume" :: held 1.533s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=147,cinder:UPDATE=181,cinder:DELETE=25,cinder:INSERT=37 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb51136-2269-4456-863d-eba2a6f1a462]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:UPDATE=187,cinder:SELECT=127,cinder:INSERT=48,cinder:DELETE=12 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['51213dbf-25e6-43dc-b2ac-17529fdd5d44', 'a84e4b77-cfe7-4e48-b3d6-a8333f63d1c7', 'ae6d3350-75d2-41aa-89ef-2b54d759e6e8', '4dd6427a-d3f3-4960-baeb-eb5e5a76f7e2'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:14 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:14 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:14 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:14 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Flow 'volume_create_manager' (fd8c630c-dec9-451b-a7a9-692cee71a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038ef4e-27fa-44c8-b787-31bcca562712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038ef4e-27fa-44c8-b787-31bcca562712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d0647e-e736-435b-b735-c7d7a1e532f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98835580d1143c287bd9597526d2022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:23:14Z,use_quota=True,user_id='44f1a563a6054b1cbe148f5b198a3723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ee8b7-fe34-4353-a0ee-da65a18caafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ee8b7-fe34-4353-a0ee-da65a18caafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3d31a-92a6-4d17-87ba-f8cf3dbaf0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce3d31a-92a6-4d17-87ba-f8cf3dbaf0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19d0647e-e736-435b-b735-c7d7a1e532f5', 'volume_name': 'volume-19d0647e-e736-435b-b735-c7d7a1e532f5', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6310f62-5e80-4673-a603-050708f96756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6310f62-5e80-4673-a603-050708f96756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4979f63b-7a36-4c1a-baa6-ee39dcc8634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:14 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Volume 19d0647e-e736-435b-b735-c7d7a1e532f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19d0647e-e736-435b-b735-c7d7a1e532f5', 'volume_size': 1} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-da5eda55-be6a-42dc-9012-56a675c55c50-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-da5eda55-be6a-42dc-9012-56a675c55c50-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-da5eda55-be6a-42dc-9012-56a675c55c50" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:14 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-da5eda55-be6a-42dc-9012-56a675c55c50" acquired by "delete_volume" :: waited 0.024s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[45906832-140c-4cef-a99a-7e4eb9d74983]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:15 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.620s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:15 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c5971485-953f-402d-b317-2a3069255d61 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-4b1e113e-8db3-48eb-a226-818f83e2d1b7-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:15 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.839s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b41fcb-1625-42b0-b5ca-fc5c08715863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ed315-df6a-489b-b341-0fc163f622b8]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:15 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 Apr 28 16:23:15 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:15 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:15 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:15 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50" returned: 0 in 0.703s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:15 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50 Apr 28 16:23:15 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:15 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.741s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:23:15 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:15 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 Apr 28 16:23:15 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:16 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-da5eda55-be6a-42dc-9012-56a675c55c50" returned: 0 in 0.605s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-da5eda55-be6a-42dc-9012-56a675c55c50" released by "delete_volume" :: held 1.351s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['1041b2e4-1cab-419f-950e-aa33ce2b8133', '56008384-1a45-4c3e-8e91-7d29cdc22c2d', 'a270d2ad-f848-4554-90a7-f6fc42a77751', '3ff5085a-37ce-4ca9-a19d-cac80f4e034c'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:16 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:16 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:16 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-015bd8b6-2644-465d-ae44-a57803d4dff6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-015bd8b6-2644-465d-ae44-a57803d4dff6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-015bd8b6-2644-465d-ae44-a57803d4dff6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-015bd8b6-2644-465d-ae44-a57803d4dff6" acquired by "delete_volume" :: waited 0.040s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea066bdc-95da-459f-86e1-6188c893a8ba]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:17 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.270s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:17 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:17 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 Apr 28 16:23:17 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:17 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-5f44f0d1-690b-4772-bb56-85f71131a2f9 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-da5eda55-be6a-42dc-9012-56a675c55c50-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:18 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6" returned: 0 in 1.280s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:18 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:18 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6 Apr 28 16:23:18 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:20 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:20 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-015bd8b6-2644-465d-ae44-a57803d4dff6" returned: 0 in 1.956s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:20 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-015bd8b6-2644-465d-ae44-a57803d4dff6" released by "delete_volume" :: held 3.343s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:20 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['03720292-aa4d-4b4b-bb90-95cd4262ea13', '9645b462-d2b6-4bfa-be52-d59047ec8d65', 'b7d23df9-7dd7-46f3-a6cf-adf476c9a41c', '8d33d758-9f3f-4514-8728-3fced567ae3e'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:21 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:21 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:21 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22" returned: 0 in 5.357s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c8409f-a5ac-44f8-bae8-a9bd17dc571f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:21 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:21 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:21 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.647s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:21 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-2f5e058f-4249-4948-8bd7-8f7f1c3725ab tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-015bd8b6-2644-465d-ae44-a57803d4dff6-delete_volume" released by "delete_volume" :: held 4.412s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-8dfc9a37-3355-4e74-b017-168bba9a5485-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-8dfc9a37-3355-4e74-b017-168bba9a5485-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-8dfc9a37-3355-4e74-b017-168bba9a5485" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-8dfc9a37-3355-4e74-b017-168bba9a5485" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[64038815-1cab-4fae-9e8e-fff508bef81c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:21 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:22 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 Apr 28 16:23:22 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:22 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.899s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:23:22 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Converted 1024.00 MB image at 191.07 MB/s Apr 28 16:23:22 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 is being set with open permissions: ugo+rw Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:22 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 Apr 28 16:23:22 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:22 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485" returned: 0 in 0.725s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:22 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485 Apr 28 16:23:22 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:22 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22" returned: 0 in 0.614s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" released by "_copy_volume_from_snapshot" :: held 8.546s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-d87e8e04-14b1-4dd3-a2de-584bac4a0324" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-d87e8e04-14b1-4dd3-a2de-584bac4a0324" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Deleting offline snapshot d87e8e04-14b1-4dd3-a2de-584bac4a0324 of volume 47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] snapshot_file for this snap is: volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2f5186-8ca1-49c8-815e-e04ac481b0f1]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:22 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:22 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:22 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:23 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-8dfc9a37-3355-4e74-b017-168bba9a5485" returned: 0 in 0.610s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-8dfc9a37-3355-4e74-b017-168bba9a5485" released by "delete_volume" :: held 1.378s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['213f8856-f075-4d01-8dfa-e9e2bab33cf8', 'e80e0352-6190-40c6-bf33-e5d8783311eb', 'bfd7dacb-fda1-4722-bee9-cf4181d583a0', '0989b9cc-50fc-4035-b7f5-d0124c37d34f'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:23 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:23 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:23 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.738s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47b41fcb-1625-42b0-b5ca-fc5c08715863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a65a1b-9535-43f5-a77f-b8191a7b3927]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:23 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:23 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:23 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:24 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.624s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:24 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-141381db-bce3-4d5d-a19d-c143dff120a9-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-c4b8a469-d925-498c-bde5-45f7eecd2c09 tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-8dfc9a37-3355-4e74-b017-168bba9a5485-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-141381db-bce3-4d5d-a19d-c143dff120a9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "cinder-quobyte-141381db-bce3-4d5d-a19d-c143dff120a9" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-141381db-bce3-4d5d-a19d-c143dff120a9" acquired by "delete_volume" :: waited 0.014s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[537e6d02-b8b9-478e-8893-1443f2f5426c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:24 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 Apr 28 16:23:24 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:24 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.741s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:24 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:24 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:24 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9" returned: 0 in 0.752s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:24 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:24 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9 Apr 28 16:23:24 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:25 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.726s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:25 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324 Apr 28 16:23:25 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:25 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-141381db-bce3-4d5d-a19d-c143dff120a9" returned: 0 in 0.610s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-quobyte-141381db-bce3-4d5d-a19d-c143dff120a9" released by "delete_volume" :: held 1.411s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Created reservations ['79d42b84-7aaf-4714-9de0-60abef40142c', '6023c1a6-d7d2-4ec9-b7da-16cbeef5b9e2', '2e74b79a-02a4-41ec-8bd7-52fe9c68e4c0', 'd64b0af1-d60b-4d53-a8cf-52d71c992926'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:25 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863.d87e8e04-14b1-4dd3-a2de-584bac4a0324" returned: 0 in 0.622s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-d87e8e04-14b1-4dd3-a2de-584bac4a0324" released by "_delete_snapshot" :: held 2.930s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:25 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:25 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.269s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 22.925s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" by "_create_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6fbc33-7d75-4e2e-90cf-2ea776aa8321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22', 'volume_size': 1, 'source_volid': '47b41fcb-1625-42b0-b5ca-fc5c08715863', 'source_volstatus': 'available'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3022177f-3b8e-490e-998f-869383b72a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Creating volume d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 from snapshot 1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" by "_copy_volume_from_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:25 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Volume volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 (bd47e75d-cd54-43cd-8be1-d60d304c4f22): created successfully Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3022177f-3b8e-490e-998f-869383b72a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Flow 'volume_create_manager' (0d388b5f-e348-43f6-80a1-0d45252c566b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] snapshot: 1a232bf1-625b-483e-aec4-e2aa4f9511b9, volume: d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58, {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:25 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-652dafdf-ddf5-4113-a072-d41caf5f0793 tempest-VolumeDependencyTests-1223462525 None] Created volume successfully. Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ed392-1483-463b-a997-d19bda210c8c]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:25 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:26 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:23:26 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:26 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.628s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:26 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Deleted volume successfully. Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-79ed9142-22d1-4603-8645-3ae8789ef4bb tempest-CreateVolumesFromSourceVolumeTest-665903810 None] Lock "cinder-141381db-bce3-4d5d-a19d-c143dff120a9-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:26 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.756s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174ac090-0796-416a-b2cf-0bdec150ebe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Creating direct copy from snapshot {{(pid=84171) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cd8119-45ac-4952-96db-7c9f6cb8b3df]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:26 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:26 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:23:26 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-47b41fcb-1625-42b0-b5ca-fc5c08715863-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-47b41fcb-1625-42b0-b5ca-fc5c08715863-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-47b41fcb-1625-42b0-b5ca-fc5c08715863" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-47b41fcb-1625-42b0-b5ca-fc5c08715863" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9290e-d9ec-4477-80dd-04c697a78ccd]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:27 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:27 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:27 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.790s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG cinder.utils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Path /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 not found in is_blk_device check {{(pid=84171) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:27 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 Apr 28 16:23:27 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:27 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.784s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:27 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:27 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863 Apr 28 16:23:27 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:28 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:28 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-47b41fcb-1625-42b0-b5ca-fc5c08715863" returned: 0 in 0.818s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:28 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-47b41fcb-1625-42b0-b5ca-fc5c08715863" released by "delete_volume" :: held 1.711s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:28 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Created reservations ['072d7f02-ffe2-4fa5-809e-66e8d428105a', 'f01555e6-c360-4b30-8db4-651ebbfbe89f', '5142c712-f450-4ece-921d-29da7b006b1f', '62712312-0c11-4b24-9d0d-efc8a42f57be'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:29 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:29 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-bd47e75d-cd54-43cd-8be1-d60d304c4f22-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-bd47e75d-cd54-43cd-8be1-d60d304c4f22-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" acquired by "delete_volume" :: waited 0.067s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[355773f0-c312-4b95-b825-19270b8a7a85]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:29 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:29 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 Apr 28 16:23:29 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:30 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:30 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 1.409s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:30 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:30 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Deleted volume successfully. Apr 28 16:23:30 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-a654d267-45cd-4b40-9344-b6213e1c1bae tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-47b41fcb-1625-42b0-b5ca-fc5c08715863-delete_volume" released by "delete_volume" :: held 3.632s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:31 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22" returned: 0 in 1.953s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:31 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:31 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22 Apr 28 16:23:31 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:32 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bd47e75d-cd54-43cd-8be1-d60d304c4f22" returned: 0 in 1.003s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bd47e75d-cd54-43cd-8be1-d60d304c4f22" released by "delete_volume" :: held 3.049s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Created reservations ['ced8a6a9-b4a4-4bfe-9d49-afec70946ab2', '65ba4b40-77cd-4de5-a0c5-2a4f6a0b877b', 'fee9f8d7-c88f-4d9f-ac52-969c4f8fe6dc', 'f139d533-ba5f-4e8d-881b-a3ae61b0a0c1'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:32 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" returned: 0 in 5.273s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2ff4f-d676-4234-8ced-2dcce4cfdea9]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:32 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:32 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:32 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:32 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:23:32 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-bb2daf01-e364-448e-be85-e1215c0c9d56-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-bb2daf01-e364-448e-be85-e1215c0c9d56-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" acquired by "delete_volume" :: waited 0.017s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[792f222a-23f7-4232-b970-e7c8bffcb33f]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:33 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 Apr 28 16:23:33 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:33 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.634s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:33 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Deleted volume successfully. Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-bcf1fff3-4e37-44b8-b3c6-f4b9572e9096 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-bd47e75d-cd54-43cd-8be1-d60d304c4f22-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:33 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.909s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG cinder.image.image_utils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 {{(pid=84171) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 16:23:33 devstack cinder-volume[84171]: INFO cinder.image.image_utils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Converted 1024.00 MB image at 194.14 MB/s Apr 28 16:23:33 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 is being set with open permissions: ugo+rw Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:33 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 Apr 28 16:23:33 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:33 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56" returned: 0 in 0.732s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:33 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:34 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56 Apr 28 16:23:34 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:34 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" returned: 0 in 0.595s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" released by "_copy_volume_from_snapshot" :: held 8.427s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" released by "_create_volume_from_snapshot" :: held 8.487s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.522s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.754s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d0647e-e736-435b-b735-c7d7a1e532f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98835580d1143c287bd9597526d2022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:23:14Z,use_quota=True,user_id='44f1a563a6054b1cbe148f5b198a3723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Creating volume 19d0647e-e736-435b-b735-c7d7a1e532f5 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:34 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:34 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 1073741824 Apr 28 16:23:34 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99f53a-bbb1-41c3-8d4c-41d28e1b3c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58', 'volume_size': 1, 'snapshot_id': '1a232bf1-625b-483e-aec4-e2aa4f9511b9'}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7461d527-00e9-4f6f-94b2-843c77b5085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:34 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Volume volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 (d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58): created successfully Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7461d527-00e9-4f6f-94b2-843c77b5085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Flow 'volume_create_manager' (78c318f6-aba5-4915-9b50-8dcf092e1d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:34 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-d46d18b1-0414-4330-b873-b3b032dba14f tempest-SnapshotDependencyTests-740370700 None] Created volume successfully. Apr 28 16:23:34 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-bb2daf01-e364-448e-be85-e1215c0c9d56" returned: 0 in 0.649s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-quobyte-bb2daf01-e364-448e-be85-e1215c0c9d56" released by "delete_volume" :: held 1.427s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Created reservations ['087f21fc-38fd-4c49-9483-7730070119d8', '06089834-35ce-44b5-80ff-c7d5f7c345de', 'a7d4dce6-f27b-428b-9b86-1733040dda90', '818b5321-98c0-4249-a939-531a9dfb6fd6'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:34 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:34 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:34 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:35 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 1073741824" returned: 0 in 0.767s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:35 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 Apr 28 16:23:35 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:35 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.643s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Deleted volume successfully. Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-911f121c-2d2b-40e2-808e-2362c1ddac78 tempest-VolumeDependencyTests-1223462525 None] Lock "cinder-bb2daf01-e364-448e-be85-e1215c0c9d56-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-1a232bf1-625b-483e-aec4-e2aa4f9511b9-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-1a232bf1-625b-483e-aec4-e2aa4f9511b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Deleting offline snapshot 1a232bf1-625b-483e-aec4-e2aa4f9511b9 of volume 174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] snapshot_file for this snap is: volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1aeb31-2f0a-41e2-8f82-f5fa8a51a51a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:35 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5" returned: 0 in 0.668s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4979f63b-7a36-4c1a-baa6-ee39dcc8634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d0647e-e736-435b-b735-c7d7a1e532f5', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dd280c-dcc5-4615-813b-34e64b16ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:35 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Volume volume-19d0647e-e736-435b-b735-c7d7a1e532f5 (19d0647e-e736-435b-b735-c7d7a1e532f5): created successfully Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dd280c-dcc5-4615-813b-34e64b16ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:35 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Flow 'volume_create_manager' (fd8c630c-dec9-451b-a7a9-692cee71a99a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:35 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-de6a2779-af73-445f-a155-68c17dd01975 tempest-CinderUnicodeTest-1814931685 None] Created volume successfully. Apr 28 16:23:35 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:23:35 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:36 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.752s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:36 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174ac090-0796-416a-b2cf-0bdec150ebe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:36 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4b51e-d5f8-4919-91fa-7bb5d1c61266]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:36 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:36 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:23:36 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84171) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Flow 'volume_create_manager' (e7b74830-a5ec-401f-9253-31486ccfae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676280d9-4f5b-4d8f-afbd-0e1b4e5cfb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676280d9-4f5b-4d8f-afbd-0e1b4e5cfb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:23:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-903586444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b17cf-39e5-4997-9b53-6d05a06110e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98835580d1143c287bd9597526d2022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:23:37Z,use_quota=True,user_id='44f1a563a6054b1cbe148f5b198a3723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b840d-5227-467d-b8a6-70b00d910241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89b840d-5227-467d-b8a6-70b00d910241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e8272e-1846-4e17-9598-d5bfadc68530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e8272e-1846-4e17-9598-d5bfadc68530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7b17cf-39e5-4997-9b53-6d05a06110e6', 'volume_name': 'volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee680c0-3c7e-4346-9aa2-ecbe6fad64fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee680c0-3c7e-4346-9aa2-ecbe6fad64fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e20c49a-2557-465e-90bf-3d72022044ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:37 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Volume 1d7b17cf-39e5-4997-9b53-6d05a06110e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6', 'volume_size': 1} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T14:23:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-903586444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7b17cf-39e5-4997-9b53-6d05a06110e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b98835580d1143c287bd9597526d2022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T14:23:37Z,use_quota=True,user_id='44f1a563a6054b1cbe148f5b198a3723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a672bb95-53ef-491e-a602-2181b12afdc5),volume_type_id=a672bb95-53ef-491e-a602-2181b12afdc5)}" {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Creating volume 1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Selected osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 as target Quobyte volume. {{(pid=84171) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 16:23:37 devstack cinder-volume[84171]: INFO cinder.volume.drivers.remotefs [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] casted to osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207 Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 1073741824 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:37 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 1073741824 Apr 28 16:23:37 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:37 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.859s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:37 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:37 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:23:37 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:38 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 1073741824" returned: 0 in 0.791s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:38 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.738s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:38 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 Apr 28 16:23:38 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:38 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9 Apr 28 16:23:38 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:38 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3.1a232bf1-625b-483e-aec4-e2aa4f9511b9" returned: 0 in 0.581s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:38 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6" returned: 0 in 0.614s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'} {{(pid=84171) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e20c49a-2557-465e-90bf-3d72022044ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6', 'volume_size': 1}' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b43b8d-da18-4b2f-bed0-3d85eadae003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-1a232bf1-625b-483e-aec4-e2aa4f9511b9" released by "_delete_snapshot" :: held 3.053s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:38 devstack cinder-volume[84171]: INFO cinder.volume.flows.manager.create_volume [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Volume volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 (1d7b17cf-39e5-4997-9b53-6d05a06110e6): created successfully Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b43b8d-da18-4b2f-bed0-3d85eadae003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84171) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Flow 'volume_create_manager' (e7b74830-a5ec-401f-9253-31486ccfae6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84171) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" released by "delete_snapshot" :: held 3.089s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-a77b3cec-4bbb-402f-9378-e151e5f0ece2 tempest-CinderUnicodeTest-1814931685 None] Created volume successfully. Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Created reservations ['9f186a56-7287-4ef3-828e-f3e611032905', 'eb42b890-2337-4be7-a3e0-bc364cacb893', 'a0bc8487-1f07-4cfe-b9c8-2e912cb3e81c', 'db860bdd-1f6e-4e3e-9d15-2c2d04cb1992'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:38 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Delete snapshot completed successfully. Apr 28 16:23:38 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-294b71ef-b955-4bf9-bb12-c75a275f8611 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-1a232bf1-625b-483e-aec4-e2aa4f9511b9-delete_snapshot" released by "delete_snapshot" :: held 3.227s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Creating offline snapshot a85333e5-b31b-4a7a-93e0-af33df905ebe of volume 1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc40cf-6b91-4358-a020-ed59cde8bdb0]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:39 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 Apr 28 16:23:39 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-174ac090-0796-416a-b2cf-0bdec150ebe3-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-174ac090-0796-416a-b2cf-0bdec150ebe3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e169657-fe3d-4486-b083-13f2943ce89a]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:39 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:40 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:23:40 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:40 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6" returned: 0 in 0.753s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe 1G {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:40 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe 1G Apr 28 16:23:40 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:40 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.703s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:40 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:40 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3 Apr 28 16:23:40 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:41 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe 1G" returned: 0 in 0.776s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:41 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe Apr 28 16:23:41 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:41 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-174ac090-0796-416a-b2cf-0bdec150ebe3" returned: 0 in 0.599s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-174ac090-0796-416a-b2cf-0bdec150ebe3" released by "delete_volume" :: held 1.362s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Created reservations ['b88bc7c9-e604-49d6-bfc4-45fb44f24fbb', 'c7499739-4bb6-4289-a882-7ff548db0967', 'f71153b9-ebbd-4328-b28e-5b680c68ad13', 'd37eb76f-2ea0-42a7-9e14-41321b9e745c'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:41 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:41 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:41 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 -F qcow2 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe" returned: 0 in 0.647s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:41 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe is being set with open permissions: ugo+rw Apr 28 16:23:41 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:41 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe Apr 28 16:23:41 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:42 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:42 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Deleted volume successfully. Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-57965e79-6b24-4d34-8ff0-79539c2e35e0 tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-174ac090-0796-416a-b2cf-0bdec150ebe3-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a46716-de21-4325-a1d5-ff31b2f247ec]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:42 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 Apr 28 16:23:42 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:42 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe" returned: 0 in 0.652s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:42 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info Apr 28 16:23:42 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:42 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" returned: 0 in 0.760s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:42 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:43 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58 Apr 28 16:23:43 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:43 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info" returned: 0 in 0.613s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:43 devstack cinder-volume[84171]: WARNING cinder.volume.drivers.remotefs [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info is being set with open permissions: ugo+rw Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:43 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info Apr 28 16:23:43 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:43 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" returned: 0 in 0.632s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-quobyte-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58" released by "delete_volume" :: held 1.430s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Created reservations ['4b062ff0-1113-4d2a-8812-44e0920b7f5b', '1c850a93-9ee5-4bea-b31d-82eeffccb5be', 'f6c06458-7bbe-4be6-9a9b-835193e5ea66', '6f8208b7-5840-4d78-b8ac-ac1727aab429'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:43 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.info" returned: 0 in 0.629s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.154s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:43 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-624d6bf2-3a86-4c40-ab70-1c3017d210f2 tempest-CinderUnicodeTest-1814931685 None] Create snapshot completed successfully Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:43 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:43 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:43 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:44 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.624s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:44 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Deleted volume successfully. Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-92552346-0eb8-4bfa-a9f4-f99a10c78dbd tempest-SnapshotDependencyTests-740370700 None] Lock "cinder-d078c3e7-9e6b-4df5-a06d-4c8f48c2ab58-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-a85333e5-b31b-4a7a-93e0-af33df905ebe-delete_snapshot" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-a85333e5-b31b-4a7a-93e0-af33df905ebe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" by "delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-quobyte-a85333e5-b31b-4a7a-93e0-af33df905ebe" by "_delete_snapshot" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-a85333e5-b31b-4a7a-93e0-af33df905ebe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Deleting offline snapshot a85333e5-b31b-4a7a-93e0-af33df905ebe of volume 1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] snapshot_file for this snap is: volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc9031-2460-4562-8d2f-bfc48356e221]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:44 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:45 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe Apr 28 16:23:45 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:45 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe" returned: 0 in 0.780s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:45 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.remotefs [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84171) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 16:23:45 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9725481-0cec-4db0-9a95-1b89e265c7ba]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:45 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:45 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 Apr 28 16:23:45 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:46 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6" returned: 0 in 0.740s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:46 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:46 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe Apr 28 16:23:46 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:47 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe" returned: 0 in 0.778s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:47 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe Apr 28 16:23:47 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:47 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:47 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6.a85333e5-b31b-4a7a-93e0-af33df905ebe" returned: 0 in 0.708s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-a85333e5-b31b-4a7a-93e0-af33df905ebe" released by "_delete_snapshot" :: held 3.144s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" released by "delete_snapshot" :: held 3.170s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:48 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Created reservations ['e2548175-8bb8-4830-89d2-988e502414dc', '5e62da52-51c2-4cfe-9ed9-1efb565e1f36', 'fd73c79e-e691-4c0c-aed6-1d69aef67cee', 'd4bc1a11-d53f-41a9-a767-381d5ee26859'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:48 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Delete snapshot completed successfully. Apr 28 16:23:48 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-845865e2-a9d4-4868-a4c7-f64be0bcebcb tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-a85333e5-b31b-4a7a-93e0-af33df905ebe-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-1d7b17cf-39e5-4997-9b53-6d05a06110e6-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-1d7b17cf-39e5-4997-9b53-6d05a06110e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" acquired by "delete_volume" :: waited 0.015s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5a652a-8ad9-4ba2-881e-ffc4c8118bf3]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:49 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 Apr 28 16:23:49 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:49 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6" returned: 0 in 0.758s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:49 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:49 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6 Apr 28 16:23:49 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:50 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-1d7b17cf-39e5-4997-9b53-6d05a06110e6" returned: 0 in 0.650s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-1d7b17cf-39e5-4997-9b53-6d05a06110e6" released by "delete_volume" :: held 1.480s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Created reservations ['cb1483d5-e7e3-45bc-91dd-566441c86d3e', '3e6c6217-a0ec-46c9-a2e0-2c1704ff5bdf', 'de90db55-a7ca-4904-8f32-253661b204be', '563042cd-4a67-472b-ace7-f3ce32fb704a'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:50 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:50 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:50 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-19d0647e-e736-435b-b735-c7d7a1e532f5-delete_volume" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:51 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.631s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-19d0647e-e736-435b-b735-c7d7a1e532f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:51 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Deleted volume successfully. Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-50aa1055-bf07-47d3-b644-1db47b03db22 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-1d7b17cf-39e5-4997-9b53-6d05a06110e6-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "cinder-quobyte-19d0647e-e736-435b-b735-c7d7a1e532f5" by "delete_volume" {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-19d0647e-e736-435b-b735-c7d7a1e532f5" acquired by "delete_volume" :: waited 0.018s {{(pid=84171) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c30d504-b527-474f-869c-9e76a5d47266]: (4, 'qcow2') {{(pid=85354) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 28 16:23:51 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:51 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 Apr 28 16:23:51 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:52 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5" returned: 0 in 0.724s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:52 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5 Apr 28 16:23:52 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:52 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:52 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f/volume-19d0647e-e736-435b-b735-c7d7a1e532f5" returned: 0 in 0.640s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:52 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-quobyte-19d0647e-e736-435b-b735-c7d7a1e532f5" released by "delete_volume" :: held 1.420s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:23:52 devstack cinder-volume[84171]: DEBUG cinder.quota [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Created reservations ['e0d50f4f-7b11-419d-8e6d-b985d35c5826', '4f9a0022-f1c7-49dd-8d87-4d2c3e52868b', '544dcb0d-5e5d-4366-a163-e034b25f95da', '5dca29e4-a374-4a0c-9dcd-bd6456331ac3'] {{(pid=84171) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:23:53 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:23:53 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:23:53 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.578s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:23:53 devstack cinder-volume[84171]: INFO cinder.volume.manager [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Deleted volume successfully. Apr 28 16:23:53 devstack cinder-volume[84171]: DEBUG cinder.coordination [None req-13f7a873-6cfc-4aee-ac9e-71f102ddede8 tempest-CinderUnicodeTest-1814931685 None] Lock "cinder-19d0647e-e736-435b-b735-c7d7a1e532f5-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=84171) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG oslo_service.periodic_task [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84171) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207': None} {{(pid=84171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG cinder.volume.drivers.quobyte [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0e90133b-951c-455f-8793-29dddb93a207'] {{(pid=84171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.lockutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 16:24:00 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 16:24:00 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f Apr 28 16:24:00 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 16:24:01 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Apr 28 16:24:01 devstack cinder-volume[84171]: DEBUG oslo_concurrency.processutils [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c60e240e77329216827e61b1fb24d5f" returned: 0 in 0.588s {{(pid=84171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 16:24:01 devstack cinder-volume[84171]: DEBUG cinder.manager [None req-4b4af4e9-97bd-4690-8951-4c787a551ca6 None None] Notifying Schedulers of capabilities ... {{(pid=84171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 16:24:03 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:SELECT=80,cinder:INSERT=32,cinder:UPDATE=115,cinder:DELETE=8 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 28 16:24:03 devstack cinder-volume[84171]: DEBUG dbcounter [-] [84171] Writing DB stats cinder:INSERT=28,cinder:UPDATE=123,cinder:SELECT=77,cinder:DELETE=9 {{(pid=84171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}